The article covers several aspects of the DBpedia community project:

• The DBpedia extraction framework.
• The mappings wiki as the central structure for maintaining the community-curated DBpedia ontology.
• Statistics on the multilingual support in DBpedia.
• DBpedia live synchronisation with Wikipedia.
• Statistics on the interlinking of DBpedia with other parts of the LOD cloud (incoming and outgoing links).
• Several usage statistics: What kind of queries are asked against DBpedia and how did that change over the past years? How much traffic do the official static and live endpoint as well as the download server have? What are the most popular DBpedia datasets?
• A description of use cases and applications of DBpedia in several areas (drop me mail if important applications are missing).
• The relation of DBpedia to the YAGO, Freebase and WikiData projects.
• Future challenges for the DBpedia project.

After our ISWC 2009 paper on DBpedia, this is the (long overdue) new reference article for DBpedia, which should provide a good introduction to the project. We submitted the article as a system report to the Semantic Web journal.

Download article as PDF.

The post New DBpedia Overview Article appeared first on DBpedia Association.

Accessing the DBpedia 3.8  Release

You can download the new DBpedia dataset from http://dbpedia.org/Downloads38.

As usual, the dataset is also available as Linked Data and via the DBpedia SPARQL endpoint at http://dbpedia.org/sparql

Credits

Lots of thanks to

• Jona Christopher Sahnwaldt (Freie Universität Berlin, Germany) for improving the DBpedia extraction framework and for extracting the DBpedia 3.8 data sets.
• Dimitris Kontokostas (Aristotle University of Thessaloniki, Greece) for implementing the language generalizations to the extraction framework.
• Uli Zellbeck and Anja Jentzsch (Freie Universität Berlin, Germany) for generating the new and updated RDF links to external datasets using the Silk interlinking framework.
• Jonas Brekle (Universität Leipzig, Germany) and Sebastian Hellmann (Universität Leipzig, Germany)for their work on the new Wikionary2RDF extractor.
• All editors that contributed to the DBpedia ontology mappings via the Mappings Wiki.
• The whole Internationalization Committee for pushing the DBpedia internationalization forward.
• Kingsley Idehen and Patrick van Kleef (both OpenLink Software) for loading the dataset into the Virtuoso instance that serves the Linked Data view and SPARQL endpoint. OpenLink Software (http://www.openlinksw.com/) altogether for providing the server infrastructure for DBpedia.

The work on the DBpedia 3.8 release was financially supported by the European Commission through the projects LOD2 – Creating Knowledge out of Linked Data (http://lod2.eu/, improvements to the extraction framework) and LATC – LOD Around the Clock (http://latc-project.eu/, creation of external RDF links).

More information about DBpedia is found at http://dbpedia.org/About

Have fun with the new DBpedia release!

Cheers,

Chris Bizer

The post DBpedia 3.8 released, including enlarged Ontology and additional localized Versions appeared first on DBpedia Association.

we are happy to announce the release of DBpedia 3.7. The new release is based on Wikipedia dumps dating from late July 2011.

The new DBpedia data set describes more than 3.64 million things, of which 1.83 million are classified in a consistent ontology, including 416,000 persons, 526,000 places, 106,000 music albums, 60,000 films, 17,500 video games, 169,000 organizations, 183,000 species and 5,400 diseases.

The DBpedia data set features labels and abstracts for 3.64 million things in up to 97 different languages; 2,724,000 links to images and 6,300,000 links to external web pages; 6,200,000 external links into other RDF datasets, and 740,000 Wikipedia categories. The dataset consists of 1 billion pieces of information (RDF triples) out of which 385 million were extracted from the English edition of Wikipedia and roughly 665 million were extracted from other language editions and links to external datasets.

Localized Editions

Up till now, we extracted data from non-English Wikipedia pages only if there exists an equivalent English page, as we wanted to have a single URI to identify a resource across all 97 languages. However, since there are many pages in the non-English Wikipedia editions that do not have an equivalent English page (especially small towns in different countries, e.g. the Austrian village Endach, or legal and administrative terms that are just relevant for a single country) relying on English URIs only had the negative effect that DBpedia did not contain data for these entities and many DBpedia users have complained about this shortcoming.

As part of the DBpedia 3.7 release, we now provide 15 localized DBpedia editions for download that contain data from all Wikipedia pages in a specific language. These localized editions cover the following languages: ca, de, el, es, fr, ga, hr, hu, it, nl, pl, pt, ru, sl, tr. The URIs identifying entities in these i18n data sets are constructed directly from the non-English title and a language-specific URI namespaces (e.g. http://ru.dbpedia.org/resource/Berlin), so there are now 16 different URIs in DBpedia that refer to Berlin. We also extract the inter-language links from the different Wikipedia editions. Thus, whenever a inter-language links between a non-English Wikipedia page and its English equivalent exists, the resulting owl:sameAs link can be used to relate the localized DBpedia URI to the equivalent in the main (English) DBpedia edition. The localized DBpedia editions are provided for download on the DBpedia download page (http://wiki.dbpedia.org/Downloads37). Note that we have not provide public SPARQL endpoints for the localized editions, nor do the localized URIs dereference. This might change in the future, as more local DBpedia chapters are set up in different countries as part of the DBpedia internationalization effort (http://dbpedia.org/Internationalization).

Other Changes

Beside the new localized editions, the DBpedia 3.7 release provides the following improvements and changes compared to the last release:

1. Framework

• Redirects are resolved in a post-processing step for increased inter-connectivity of 13% (applied for English data sets)
• Extractor configuration using the dependency injection principle
• Simple threaded loading of mappings in server
• Improved international language parsing support thanks to the members of the Internationalization Committee: http://dbpedia.org/Internationalization

2. Bugfixes

• Encode homepage URLs to conform with N-Triples spec
• Correct reference parsing
• Recognize MediaWiki parser functions
• Raw infobox extraction produces more object properties again
• skos:related for category links starting with “:” and having and anchor text
• Restrict objects to Main namespace in MappingExtractor
• Double rounding (e.g. a person’s height should not be 1800.00000001 cm)
• Start position in abstract extractor
• Server can handle template names containing a slash
• Encoding issues in YAGO dumps

3. Ontology

• 320 ontology classes
• 750 object properties
• 893 datatype properties
• owl:equivalentClass and owl:equivalentProperty mappings to http://schema.org

Note that the ontology now is a directed-acyclic graph. Classes can have multiple superclasses, which was important for the mappings to schema.org. A taxonomy can still be constructed by ignoring all superclass but the one that is specified first in the list and is considered the most important.

4. Mappings

• Dynamic statistics for infobox mappings showing the overall and individual coverage of the mappings in each language: http://mappings.dbpedia.org/index.php/Mapping_Statistics
• Improved DBpedia Ontology as well as improved Infobox mappings using http://mappings.dbpedia.org/. These improvements are largely due to collective work by the community before and during the DBpedia Mapping Creation Sprint. For English, there are 17.5 million RDF statements based on mappings (13.8 million in version 3.6) (see also http://dbpedia.org/Downloads37#ontologyinfoboxproperties).
• ConstantProperty mappings to capture information from the template title (e.g. Infobox_Australian_Road {{TemplateMapping | mapToClass = Road | mappings = {{ConstantMapping | ontologyProperty = country | value = Australia }}}})
• Language specification for string properties in PropertyMappings (e.g. Infobox_japan_station: {{PropertyMapping | templateProperty = name | ontologyProperty = foaf:name | language = ja}} )
• Multiplication factor in PropertyMappings (e.g. Infobox_GB_station: {{PropertyMapping | templateProperty = usage0910 | ontologyProperty = passengersPerYear | factor = 1000000}}, because it’s always specified in millions)

5. RDF Links to External Data Sources

• New RDF links pointing at resources in the following Linked Data sources: Umbel, EUnis, LinkedMDB, Geospecis
• Updated RDF links pointing at resources in the following Linked Data sources: Freebase, WordNet, Opencyc, New York Times, Drugbank, Diseasome, Flickrwrapper, Sider, Factbook, DBLP, Eurostat, Dailymed, Revyu

Accessing the new DBpedia Release

You can download the new DBpedia dataset from http://dbpedia.org/Downloads37.

As usual, the dataset is also available as Linked Data and via the DBpedia SPARQL endpoint (http://dbpedia.org/sparql).

Credits

Lots of thanks to

• All editors that contributed to the DBpedia ontology mappings via the Mappings Wiki.
• Max Jakob (Freie Universität Berlin, Germany) for improving the DBpedia extraction framework and for extracting the new datasets.
• Dimitris Kontokostas (Aristotle University of Thessaloniki, Greece) for providing language generalizations to the extraction framework.
• Paul Kreis (Freie Universität Berlin, Germany) for administering the ontology and for delivering the mapping statistics and schema.org mappings.
• Uli Zellbeck (Freie Universität Berlin, Germany) for providing the links to external datasets using the Silk framework.
• The whole Internationalization Committee for expanding some DBpedia extractors to a number of languages:
  http://dbpedia.org/Internationalization.
• Kingsley Idehen and Mitko Iliev (both OpenLink Software) for loading the dataset into the Virtuoso instance that serves the Linked Data view and SPARQL endpoint. OpenLink Software (http://www.openlinksw.com/) altogether for providing the server infrastructure for DBpedia.

The work on the new release was financially supported by:

• The European Commission through the project LOD2 – Creating Knowledge out of Linked Data (http://lod2.eu/, improvements to the extraction framework).
• The European Commission through the project LATC – LOD Around the Clock (http://latc-project.eu/, creation of external RDF links).
• Vulcan Inc. as part of its Project Halo (http://www.projecthalo.com/).

More information about DBpedia is found at http://dbpedia.org/About

Have fun with the new data set!

Cheers,

Chris Bizer

The post DBpedia 3.7 released, including 15 localized Editions appeared first on DBpedia Association.

Within the news portal Ontos crawls news articles from diverse online sources, uses its cutting-edge NLP technology to extract facts (objects and relations between them), merges these information with existing ones and stores them including respective references to the original news article – all of this fully automatically. Facts from Ontos’ portal are accessible via a RESTful HTTP API. Fetching data is free – in order to receive an API key, developers have to register (e-mail address only!) at Ontos’ homepage.

For humans Ontos provides a search interface at http://www.ontosearch.com. It allows to look-up objects in the database and viewing respective summaries in HTML or RDF.

Please note that the generated RDF does currently contain a small part of existing information (e. g. no article references yet). Ontos will extend the respective content step-by-step.

The post Links to DBpedia from Ontos NLP web services appeared first on DBpedia Association.

See:

• Komplett verlinkt (Description of the broadcast, German)
• Broadcast, 3Sat, 21.6.2009 (German)

Background information:

• DBpedia – A Crystallization Point for the Web of Data. To appear in: Journal of Web Semantics (JWS), Special Issue on the Web of Data.
• Linked Data – The Story So Far. To appear in: Journal on Semantic Web and Information Systems (IJSWIS), Special Issue on Linked Data.

The post 3sat TV magazine features Linked Data and DBpedia appeared first on DBpedia Association.

The new knowledge base has been extracted from the October 2008 Wikipedia dumps. Compared to the last release, the new knowledge base provides three mayor improvements:

1. DBpedia Ontology

DBpedia now features a shallow, cross-domain ontology, which has been manually created based on the most commonly used infoboxes within Wikipedia. The ontology currently covers over 170 classes which form a subsumption hierarchy and have 940 properties. The ontology is instanciated by a new infobox data extraction method which is based on hand-generated mappings of Wikipedia infoboxes to the DBpedia ontology. The mappings define fine-granular rules on how to parse infobox values. The mappings also adjust weaknesses in the Wikipedia infobox system, like having different infoboxes for the same class (currently 350 Wikipedia templates are mapped to 170 ontology classes), using different property names for the same property (currently 2350 template properties are mapped to 940 ontology properties), and not having clearly defined datatypes for properties. Therefore, the instance data within the infobox ontology is much cleaner and better structured than the infobox data within the DBpedia infobox dataset which is generated using the old infobox extraction code. The DBpedia Ontology currently contains about 882.000 instances.

More information about the ontology is found at http://wiki.dbpedia.org/Ontology

2. RDF Links to Freebase

Freebase is an open-license database which provides data about million of things from various domains. Freebase has recently released an Linked Data interface to their content. As there is a big overlap between DBpedia and Freebase, we have added 2.4 million RDF links to DBpedia pointing at the corresponding things in Freebase. These links can be used to smush and fuse data about a thing from DBpedia and Freebase.

For more information about the Freebase links see
http://blog.dbpedia.org/2008/11/15/dbpedia-is-now-interlinked-with-freebase-links-to-opencyc-updated/

3. Cleaner Abstacts

Within the old DBpedia dataset it occurred that the abstracts for different languages contained Wikpedia markup and other strange characters. For the 3.2 release, we have improved DBpedia’s abstract extraction code which results in much cleaner abstracts that can safely be displayed in user interfaces.

Access the new DBpedia knowledge base 

The new DBpedia release can be downloaded from:

http://wiki.dbpedia.org/Downloads32

and is also available via the DBpedia SPARQL endpoint at

http://dbpedia.org/sparql

and via DBpedia’s Linked Data interface. Example URIs:

http://dbpedia.org/resource/Berlin
http://dbpedia.org/page/Oliver_Stone

Lots of thanks to everybody who contributed to the Dbpedia 3.2 release!

Especially:

1. Georgi Kobilarov (Freie Universität Berlin) who designed and implemented the new infobox extraction framework.
2. Anja Jentsch (Freie Universität Berlin) who contributed to implementing the new extraction framework and wrote the infobox to ontology class mappings.
3. Paul Kreis (Freie Universität Berlin) who improved the datatype extraction code.
4. Andreas Schultz (Freie Universität Berlin) for generating the Freebase to DBpedia RDF links.
5. Everybody at OpenLink Software for hosting DBpedia on a Virtuoso server and for providing the statistics about the new Dbpedia knowledge base.

Have fun with the new DBpedia knowledge base!

The post DBpedia version 3.2 released including the new DBpedia Ontology appeared first on DBpedia Association.

 We have also updated the the RDF links to OpenCyc, which allow you to use DBpedia instance data together with conceptual knowledge of OpenCyc.

Example Freebase Link

http://dbpedia.org/resource/Woody_Allen owl:sameAs  http://rdf.freebase.com/ns/guid.9202a8c04000641f800000000004064f

Example Open Cyc Link

http://dbpedia.org/resource/Tetris owl:sameAs http://sw.opencyc.org/2008/06/10/concept/Mx4rv9-ZUpwpEbGdrcN5Y29ycA

The links are available via the DBpedia Linked Data interface and via SPARQL endpoint and can also be downloaded as single files:

• Links to Freebase

• Links to OpenCyc

The post DBpedia is now interlinked with Freebase. Links to OpenCyc updated. appeared first on DBpedia Association.

DBpedia Mobile is a location-aware client for the Semantic Web that can be used on an iPhone and other mobile devices. Based on the current GPS position of a mobile device, DBpedia Mobile renders a map indicating nearby locations from the DBpedia dataset. Starting from this map, the user can explore background information about his surroundings by navigating along data links into otherWeb data sources. DBpedia Mobile has been designed for the use case of a tourist exploring a city. As the application is not restricted to a xed set of data sources but can retrieve and display data from arbitrary Web data sources, DBpedia Mobile can also be employed within other use cases, including ones unforeseen by its developers. Besides accessing Web data, DBpedia Mobile also enables users to publish their current location, pictures and reviews to the Semantic Web so that they can be used by other Semantic Web applications. Instead of simply being tagged with geographical coordinates, published content is interlinked with a nearby DBpedia resource and thus contributes to the overall richness of the Geospatial Semantic Web.

For more information about DBpedia Mobile please refer to:

• Semantic Web Challenge Submission
• Slides from our presentation at the conference.

The post DBpedia Mobile won the 2nd prize of the Semantic Web Challenge 2008 appeared first on DBpedia Association.

More information about DBpedia Mobile is found on the project website.

The post DBpedia Mobile released. appeared first on DBpedia Association.

Together with the committed OpenCyc community we produced a first DBpedia-Cyc linkage, which is now available as a DBpedia dataset from the downloads section. The dataset will soon also be loaded into the DBpedia SPARQL endpoint and made available as linked data. More information about the linkage can be found at: http://wiki.dbpedia.org/OpenCyc

The post DBpedia-Cyc linkage appeared first on DBpedia Association.