Have you thought about using dbpedia? https://en.wikipedia.org/wiki/DBpedia

frik · on Feb 19, 2017

Has someone tried to host a DBpedia copy offline?

The supported Virtuoso database is quite esoteric ( https://en.wikipedia.org/wiki/Virtuoso_Universal_Server ).

Has one succeeded writing a script to import the data to Postgres, MySQL or Lucene?

nl · on Feb 19, 2017

I've hosted it in Jena, and I think most graph databases include importers.

You need a RDF/Graph database (unless you are up for a lot of re-engineering)

alex_g · on Feb 19, 2017

I hadn't but I will now. Thanks for sharing!

EGreg · on Feb 19, 2017

How does DBpedia compare with WikiData?

frik · on Feb 19, 2017

There was Freebase with a community around the project. Sadly Google took it offline and now only use it internally, and prevent others AI projects and competitors like IBM (Watson), Apple (Siri), and Microsoft (Cortana) from using it. So IVM bought Blekko semantic search engine, Apple has now its own web crawler, and Microsoft already bought various SV startups like Powerset to enhance MSN/Live/Bing search.

DBpedia is big as well.

WikiData is several magnitudes smaller than Freebase and DBpedia at the moment, but has an active healthy community.

What's the best way to run an offline copy of WikiData these days? Does it run on MySQL (or Postgres) like all other Wikimedia properties?

nl · on Feb 19, 2017

There was Freebase with a community around the project. Sadly Google took it offline

This isn't what happened. Freebase is still available to download and is slowly (with Google support) being migrated to WikiData[1].

There are some other pretty large Knowledge Graphs around. ConceptNet and Probase/MS Concept Graph are two that are worth looking at.

[1] https://static.googleusercontent.com/media/research.google.c...

Gaelan · on Feb 19, 2017

I'd assume so, because it acts like a highly specialized MediaWiki.