News from Jan 16, 2012
LDIF can be used within Linked Data applications to translate heterogeneous data from the Web of Linked Data into a clean local target representation while keeping track of data provenance. LDIF translates data from the Web into a consistent target vocabulary. LDIF includes an identity resolution component which translates URI aliases into single target URI.
Up till now, LDIF stored data purely in-memory. This restricted the amount of data that could be processed. LDIF Version 0.4 introduces two new implementations of the LDIF runtime environment which allow LDIF to scale to large data sets:
We have tested LDIF for integrating RDF data sets ranging from 25 million to 3.6 billion triples.
A comparison of the performance of all three implementations is found on the LDIF benchmark page:
LDIF is provided under the terms of the Apache Software License. LDIF can be downloaded from the project webpage which also provides detailed information about the features and the configuration of the framework:
The development of LDIF is supported in part by Vulcan Inc. as part of its Project Halo and by the EU FP7 project LOD2 (Grant No. 257943).