【转】知识图谱(KG)存储、可视化、公开数据集、图计算、图编程工具分享
知识图谱(Knowledge Graph),在图书情报界称为知识域可视化或知识领域映射地图,是显示知识发展进程与结构关系的一系列各种不同的图形,用可视化技术描述知识资源及其载体,挖掘、分析、构建、绘制和显示知识及它们之间的相互联系。知识图谱是通过将应用数学、图形学、信息可视化技术、信息科学等学科的理论与方法与计量学引文分析、共现分析等方法结合,并利用可视化的图谱形象地展示学科的核心结构、发展历史、
知识图谱(Knowledge Graph),在图书情报界称为知识域可视化或知识领域映射地图,是显示知识发展进程与结构关系的一系列各种不同的图形,用可视化技术描述知识资源及其载体,挖掘、分析、构建、绘制和显示知识及它们之间的相互联系。
知识图谱是通过将应用数学、图形学、信息可视化技术、信息科学等学科的理论与方法与计量学引文分析、共现分析等方法结合,并利用可视化的图谱形象地展示学科的核心结构、发展历史、前沿领域以及整体知识架构达到多学科融合目的的现代理论。它能为学科研究提供切实的、有价值的参考。
本资源整理了知识图谱相关开源工具,涉及知识图谱公开数据集、知识图谱存储、可视化、知识融合、知识图谱计算相关工具、资料。
目录
基础架构
o图数据库工具
o三元组存储工具
o图计算框架工具
o图可视化工具
o图处理相关编程语言
o图应用服务工具
知识工程
o知识融合
知识图谱数据集
o一般数据集
o语义网络数据集
o学术数据集
学习资料
o官方文档
o学习社区资料
基础架构
图数据库工具
AgensGraph - multi-model graph database with SQL and Cypher support based on PostgreSQL
ArangoDB - highly available Multi-Model NoSQL database
Blazegraph - GPU accelerated graph database
Cayley - open source database written in Go
CosmosDB - cloud-based multi-model database with support for TinkerPop3
Dgraph - Fast, Transactional, Distributed Graph Database (open source, written in Go)
DSE Graph - Graph layer on top of DataStax Enterprise (Cassandra, SolR, Spark)
Grakn.AI - a distributed hyper-relational database for knowledge-oriented systems, i.e. a distributed knowledge base
Graphd - the Metaweb/Freebase Graph Repository
JanusGraph - an open-source, distributed graph database with pluggable storage and indexing backends
Memgraph - High Performance, In-Memory, Transactional Graph Database
Neo4j - OLTP graph database
Sparksee - makes space and performance compatible with a small footprint and a fast analysis of large networks
Stardog - RDF graph database with OLTP and OLAP support
OrientDB - Distributed Multi-Model NoSQL Database with a Graph Database Engine
TigerGraph - a complete, distributed, parallel graph computing platform for enterprise, supporting web-scale data analytics in real-time.
Nebula Graph - A truly distributed, linear scalable, lightning-fast graph database, using SQL-like query language.
HugeGraph - An open source TinkerPop 3 compliant OLTP Graph Database with pluggable storage bakcend which is similar to JanusGraph. It also supports OLAP through Spark GraphX.
三元组存储工具
AllegroGraph - high-performance, persistent graph database that scales to billions of quads
Apache Jena - open source Java framework for building Semantic Web and Linked Data applications
Eclipse RDF4J - (formerly known as Sesame) is an open source Java framework for processing RDF data. This includes parsing, storing, inferencing and querying of/over such data. It offers an easy-to-use API that can be connected to all leading RDF storage solutions. It allows you to connect with SPARQL endpoints and create applications that leverage the power of linked data and Semantic Web.
GraphDB - enterprise ready Semantic Graph Database, compliant with W3C Standards
Virtuoso - a "Data Junction Box" that drives enterprise and individual agility by deriving a Semantic Web of Linked Data from existing data silos
Hoply - explore bigger than RAM relational data in the comfort of Python.
图计算框架工具
Apache Giraph - an iterative graph processing system built for high scalability
Apache TinkerPop - a graph computing framework for both graph databases (OLTP) and graph analytic systems (OLAP)
Apache Spark - GraphX - Apache Spark's API for graphs and graph-parallel computation
Tencent Plato - a fast distributed graph computation and machine learning framework used by WeChat.
图可视化工具
AntV G6 - Simple, easy and complete high performance graph visualization engine written in JavaScript, from Ant Financial
Gephi - Graph visualization platform software runs on Windows, Mac and Linux.
KeyLines & ReGraph - Graph visualization tookits for JavaScript and React developer from Cambridge Intelligence.
Linkurious - Linkurious is an enterprise ready on-premises graph visualization and analysis platform.
图处理相关编程语言
Cypher
Gremlin
SPARQL
GraphQL+- - The query language of Dgraph, which is based on Facebook's GraphQL
GQL - An initiative to create a standard query language for property graph database, just like SQL for relational database.
图应用服务工具
CosmosDB @ Microsoft - Azure Cosmos DB is Microsoft's globally distributed, multi-model (Key-value, Document, Column, Graph) database service.
JanusGraph @ IBM Compose
JanusGraph @ Google Cloud Platform - JanusGraph on Google Kubernetes Engine backed by Google Cloud Bigtable
JanusGraph @ Amazon Web Services Labs - The Amazon DynamoDB Storage Backend for JanusGraph
Neo4j @ Graphene
Neo4j @ Graph Story - End-to-end Graph Database hosting for Community and Enterprise Neo4j with expert help for development
Neptune @ Amazon Web Services - a fast, reliable, fully-managed graph database service that makes it easy to build and run applications that work with highly connected datasets
Graph Engine Service @ Huawei Cloud - Fully-managed, distributed, at-scale graph query and analysis service that provides a visualized interactive analytics platform.
Graph Database (beta) @ Aliyun (Alibaba Cloud) - highly reliable and available property graph database that supports ACID and TinkerPop Gremlin query language.
Tencent Knowledge Graph @ Tencent Cloud - One stop platform for Graph database, computing and visualization. Currently available in beta test and only in Chinese.
知识工程
YAGA-NAGA - Harvesting, Searching, and Ranking Knowledge from the Web
知识融合
Dedupe - dedupe is a python library that uses machine learning to perform fuzzy matching, deduplication and entity resolution quickly on structured data.
LIMES - Link Discovery Framework for Metric Spaces.
知识图谱数据集
一般数据集
BabelNet - Both a multilingual encyclopedic dictionary, with lexicographic and encyclopedic coverage of terms, and a semantic network which connects concepts and named entities in a very large network of semantic relations, made up of about 16 million entries, called Babel synsets. Each Babel synset represents a given meaning and contains all the synonyms which express that meaning in a range of different languages.
Wikidata - Wikidata is a free, collaborative, multilingual, secondary database, collecting structured data to provide support for Wikipedia, Wikimedia Commons, the other wikis of the Wikimedia movement, and to anyone in the world.
Google Knowledge Graph - Google’s Knowledge Graph has millions of entries that describe real-world entities like people, places, and things.
DBpedia - DBpedia is a crowd-sourced community effort to extract structured content from the information created in various Wikimedia projects.
XLore - A large-scale English-Chinese bilingual knowledge graph by structuring and integrating Chinese Wikipedia, English Wikipedia, French Wikipedia, and Baidu Baike.
The GDELT Project - The GDELT Project monitors the world's broadcast, print, and web news from nearly every corner of every country in over 100 languages and identifies the people, locations, organizations, themes, sources, emotions, counts, quotes, images and events driving our global society every second of every day, creating a free open platform for computing on the entire world.
YAGO - A huge semantic knowledge base, derived from Wikipedia, WordNet and GeoNames. Currently, YAGO has knowledge of more than 10 million entities (like persons, organizations, cities, etc.) and contains more than 120 million facts about these entities. The source code of YAGO is in this Github repo.
Zhishi.me - Knowledge Graph data extracted from the largest Chinese encyclopedias, Baidu Baike, Hudong Baike and Chinese Wikipedia.
语义网络数据集
ConceptNet - ConceptNet is a freely-available semantic network, designed to help computers understand the meanings of words that people use.
Microsoft Concept Graph - For Short Text Understanding
OpenHowNet - An Open Sememe-based Lexical Knowledge Base in Chinese.
WordNet - A free large lexical database of English from Princeton University.
学术数据集
AMiner - Aminer aims to provide comprehensive search and mining services for researcher social networks.
Microsoft Academic - Microsoft Academic (MA) employs advances in machine learning, semantic inference and knowledge discovery to help you explore scholarly information in more powerful ways than ever before.
AceMap - Academic search engine based on knowledge graph which includes entities like paper, author, institution and etc.
学习资料
官方文档
Cypher - reference documentation
Gremlin - reference documentation
学习社区资料
Graph Book - TinkerPop3 centric book written by Kelvin R. Lawrence
SQL2Gremlin - transition from SQL to Gremlin by Daniel Kuppitz
The Gremlin Compendium - minimum survival kit for any Gremlin user, 10 blog post series by Doan DuyHai
相关会议
Graph Connect - powered by Neo4j
Graph Day - an Independent Graph Conference from the Data Day folks
更多推荐
所有评论(0)