Home

Deploying and Using SPARQL-DQP

PART A. Downloading OGSA-DAI

• mkdir $HOME/Applications

• git clone https://github.com/cbuil/sparql-dqp.git

• Download OGSA-DAI distribution :
  1. cd $HOME/Applications
  2. wget http://downloads.sourceforge.net/project/ogsa-dai/OGSA-DAI-4.2/ogsadai-4.2-jersey-1.10-bin.zip
  3. unzip ogsadai-4.2-jersey-1.10-bin.zip
  4. unlink ogsadai
  5. ln -s ogsadai-4.2-jersey-1.10-bin ogsadai

• JAVA 7 (Linux 64 bits)
  1. cd $HOME/Applications
  2. wget http://javadl.sun.com/webapps/download/AutoDL?BundleId=75252
  3. mv AutoDL\?BundleId\=75252 jre-7u17-linux-x64.tar.gz
  4. tar zxvf jre-*-linux-x64.tar.gz
  5. unlink jre
  6. ln -s jre*/ jre

• JAVA 7 (Linux 32 bits)
  1. cd $HOME/Applications
  2. wget http://javadl.sun.com/webapps/download/AutoDL?BundleId=75250
  3. mv AutoDL\?BundleId\=75250 jre-7u17-linux-i586.tar.gz
  4. tar zxvf jre-*-linux-i586.tar.gz
  5. unlink jre
  6. ln -s jre*/ jre

• Apache Tomcat:
  1. cd $HOME/Applications
  2. wget http://ftp.cixug.es/apache/tomcat/tomcat-7/v7.0.47/bin/apache-tomcat-7.0.47.zip
  3. unzip apache-tomcat-7*.zip
  4. unlink tomcat
  5. ln -s apache-tomcat-7.*/ tomcat
  6. chmod +x tomcat/bin/*.sh

• Apache Ant :
  1. cd $HOME/Applications
  2. wget http://apache.rediris.es//ant/binaries/apache-ant-1.9.2-bin.zip
  3. unzip apache-ant-1.9.0-bin
  4. unlink ant
  5. ln -s apache-ant-1.9.0 ant

PART B. Building SPARQL-DQP

• Setting variables
  • export CATALINA_HOME=$HOME/Applications/tomcat
  • export ANT_HOME=$HOME/Applications/ant
  • export PATH=$PATH:$ANT_HOME/bin
  • export OGSADAI_HOME=$HOME/Applications/ogsadai
  • export JAVA_HOME=$HOME/Applications/jre

• please check that you have set the following environment variables
  • echo $CATALINA_HOME
  • echo $OGSADAI_HOME
  • echo $JAVA_HOME
  • echo $ANT_HOME

• Build SPARQL-DQP server jar and deploy to tomcat (this will also copy the necessary configuration files)
  1. cd $HOME/sparql-dqp
  2. mkdir bin
  3. ant deploy-to-server

• Configure SPARQL-DQP
  1. Look at t he following configuration files in $CATALINA_HOME/webapps/dai/WEB-INF/etc/dai
  2. Configure $CATALINA_HOME/webapps/dai/WEB-INF/etc/dai/dqp/DQPresource/DQPContext.xml with the number of nodes you need
  3. Configure $CATALINA_HOME/webapps/dai/WEB-INF/etc/dai/dqp/DQPCompilerConfiguration.xml with the optimisers you need, specially the visualiser optimiser that generates a figure with the query plan

1. Stop tomcat
   1. $CATALINA_HOME/bin/catalina.sh stop
2. Install ogsa-dai normally in your tomcat folder (don’t forget to modify the logging properties file $OGSADAI_HOME/dai/WEB-INF/classes/log4j.properties according to your environment)
   1. cd $OGSADAI_HOME
   2. ant -Dtomcat.dir=$CATALINA_HOME deploy
3. Run setenv for adding that jar in the class path
   1. cd $OGSADAI_HOME
   2. source setenv.sh
4. Start Tomcat
   1. $CATALINA_HOME/bin/catalina.sh start
5. Make sure that all necessary jars for SPARQL-DQP are in $CATALINA_HOME/webapps/dai/WEB-INF/lib/
   1. cd $HOME/Applications
   2. cp $sparql-dqp/lib/* $CATALINA_HOME/webapps/dai/WEB-INF/lib/
6. Maybe there will be some conflicts with slf4j-api and log. Remove the oldest version (you may see it when running the client)
   1. cd $HOME/Applications
   2. rm tomcat/webapps/dai/WEB-INF/lib/slf4j-api-1.5.6.jar
   3. rm tomcat/webapps/dai/WEB-INF/lib/slf4j-log4j12-1.5.6.jar
7. Restart tomcat
   1. $CATALINA_HOME/bin/catalina.sh stop
   2. $CATALINA_HOME/bin/catalina.sh start

PART C. Running SPARQL-DQP

• Run the query
  • OEG Members GFT Table Example: https://www.google.com/fusiontables/DataSource?docid=1pQBGUqR_g-j1WQavu-Fi1wGS7jsdRxomGc0DxMI#rows:id=1
  1. cd $OGSADAI_HOME
  2. $JAVA_HOME/bin/java es.upm.fi.dia.oeg.ogsadai.sparql.client.QueryClient -f FusionTableQuery.rq