GitHub - pivotal/outsourcer

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 46 Commits
bin		bin
fi/iki/elonen		fi/iki/elonen
jar		jar
sql		sql
yml		yml
5.2.3.zip		5.2.3.zip
AgentD.java		AgentD.java
CommonDB.java		CommonDB.java
CustomSQL.java		CustomSQL.java
CustomSQLControl.java		CustomSQLControl.java
CustomSQLModel.java		CustomSQLModel.java
CustomSQLView.java		CustomSQLView.java
EnvironmentControl.java		EnvironmentControl.java
EnvironmentModel.java		EnvironmentModel.java
EnvironmentView.java		EnvironmentView.java
ExternalData.java		ExternalData.java
ExternalDataD.java		ExternalDataD.java
ExternalDataThread.java		ExternalDataThread.java
ExternalTableControl.java		ExternalTableControl.java
ExternalTableModel.java		ExternalTableModel.java
ExternalTableView.java		ExternalTableView.java
GP.java		GP.java
GpfdistRunner.java		GpfdistRunner.java
JobControl.java		JobControl.java
JobModel.java		JobModel.java
JobView.java		JobView.java
LICENSE.txt		LICENSE.txt
Logger.java		Logger.java
OSProperties.java		OSProperties.java
Oracle.java		Oracle.java
Outsourcer-5_2_3.pdf		Outsourcer-5_2_3.pdf
Outsourcer-Oracle-Source-Guide.pdf		Outsourcer-Oracle-Source-Guide.pdf
OutsourcerControl.java		OutsourcerControl.java
OutsourcerModel.java		OutsourcerModel.java
OutsourcerView.java		OutsourcerView.java
QueueControl.java		QueueControl.java
QueueModel.java		QueueModel.java
QueueView.java		QueueView.java
README.txt		README.txt
SQLServer.java		SQLServer.java
ScheduleControl.java		ScheduleControl.java
ScheduleModel.java		ScheduleModel.java
ScheduleView.java		ScheduleView.java
ServerRunnerUI.java		ServerRunnerUI.java
UI.java		UI.java
UIConnectionFactory.java		UIConnectionFactory.java
UIModel.java		UIModel.java
UIView.java		UIView.java
compile.sh		compile.sh
config.properties		config.properties
manifest.txt		manifest.txt
os_install.sh		os_install.sh
os_path.sh		os_path.sh
version.sh		version.sh

Repository files navigation

README file for Outsourcer
***********************************************************************************
Site: http://www.PivotalGuru.com
Author: Jon Roberts
Email: [email protected]
***********************************************************************************
Outsourcer automates the tasks typically done manually by ETL developers to source 
data from SQL Server and Oracle and load into Greenplum or HAWQ database.  

* Connects to Source databases (SQL Server or Oracle)
* Converts Source DDL to Greenplum/HAWQ syntax and creates target schema and table
* Loads data into Greenplum/HAWQ automatically
* Supports multiple job types:
	* Refresh (truncate and reload)
	* Append (add only new data from source)
	* Replication (tracks changes in the source and applies the changes)
	* Transform (SQL commands to execute in Greenplum/HAWQ)
* Multi-threaded with dynamic number of jobs to execute concurrently
* Scheduler for recurring job execution
* Open Source!
* Automatic data cleansing
* Utilizes gpfdist for fast data loading