Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tap hubspot unauthorized for url exception #117

Open
wants to merge 89 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
89 commits
Select commit Hold shift + click to select a range
b03c6c3
add lastUpdated field in engagements schema
Nov 25, 2019
c0be3c5
Merge pull request #1 from dreamdata-io/add_lastUpdated_engagements_s…
Nov 25, 2019
b8cfaa7
add custom values in .gitignore
Nov 25, 2019
5212a68
change schema to accept values with underscore for contacts_to_company
Nov 25, 2019
0249ad6
write contacts_to_company values with underscore
Nov 25, 2019
d25eb16
if contacts_by_company in ctx.selected_stream_ids
Nov 25, 2019
3ceb026
add Pipfile.lock in .gitignore
Nov 26, 2019
449a85a
Merge pull request #2 from dreamdata-io/contacts_to_company
Nov 26, 2019
61145a7
get companies by batch
Nov 28, 2019
435dbff
add contacts by company
Nov 28, 2019
5372cb9
set count to 250
Nov 28, 2019
2d419bf
request website, name and country for company
Nov 28, 2019
99de191
support domain in batch get for companies
Nov 28, 2019
43279d2
Merge pull request #3 from dreamdata-io/get_companies_batch
dallerup Nov 28, 2019
1cc06bb
black commit
paddie Jan 6, 2020
6e83a49
remove string as an option for numbers
paddie Jan 6, 2020
929f4b1
add function to remove all N/A from an object
paddie Jan 6, 2020
63087ec
remove N/A from all records/rows when sync'ing
paddie Jan 6, 2020
3fc807b
Merge pull request #4 from dreamdata-io/solve-multiple-types-issue
Jan 6, 2020
204de23
black commit
Jan 8, 2020
6804118
change schema dash to underscore
Jan 8, 2020
359eed1
change record dash to underscore
Jan 8, 2020
f46d5e7
Merge pull request #5 from dreamdata-io/replace_dash-to-under-score
JingLin0 Jan 8, 2020
7e6d588
black commit
paddie Jan 8, 2020
ddf0bc3
bump dependencies
paddie Jan 8, 2020
02cd846
Merge pull request #6 from dreamdata-io/relax-dependencies-a-bit
paddie Jan 14, 2020
c70b97f
lift schema from catalog in contacts
paddie Jan 16, 2020
1ba0193
use catalog schema in contacts_by_companies
paddie Jan 16, 2020
9881146
catalog.. schemas.. you get the gist
paddie Jan 16, 2020
51ca8b5
remove unused variables
paddie Jan 16, 2020
0c68b3d
campaigns catalog schema
paddie Jan 16, 2020
107af7d
sync_entity_chunked schema
paddie Jan 16, 2020
2179973
workflows schema from catalog
paddie Jan 16, 2020
86e8595
owners schema change
paddie Jan 16, 2020
416c2d5
engagements... schema
paddie Jan 16, 2020
b5561f3
deal pipeline
paddie Jan 16, 2020
d546f44
Merge pull request #7 from dreamdata-io/do-not-rebuild-schema-on-each…
paddie Jan 16, 2020
a4cc5c2
prettier commit
JingLin0 Feb 18, 2020
23cf922
only include fields that are needed
JingLin0 Feb 18, 2020
69241e0
delete unused catalogs
JingLin0 Feb 18, 2020
721b64b
delete custom schema update
JingLin0 Feb 18, 2020
677810f
delete unused functions
JingLin0 Feb 19, 2020
6a75d25
add missed field
JingLin0 Feb 19, 2020
56a3b52
Merge pull request #8 from dreamdata-io/use-static-catalog
JingLin0 Feb 19, 2020
87ccbe1
do not show get request
JingLin0 Feb 28, 2020
332b59c
add hs_lastmodifieddate field
JingLin0 Mar 15, 2020
24dc42b
sync table companies incrementally
JingLin0 Mar 15, 2020
edc5742
update deal-pipeline schema
JingLin0 Mar 16, 2020
2969fcc
/deals/v1/pipelines endpoint is deprecated
JingLin0 Mar 16, 2020
2fd3657
sync deal-pipeline incrementally with new replication key
JingLin0 Mar 16, 2020
b968465
avoid repetition of data
JingLin0 Mar 16, 2020
947511a
Merge pull request #9 from dreamdata-io/fix-deal-update
JingLin0 Mar 16, 2020
3b3fb85
delete test files
JingLin0 Apr 13, 2020
5eb3bbc
include major cli functions
JingLin0 Apr 13, 2020
0d1613d
handle all api calls and get replication values
JingLin0 Apr 13, 2020
d53acf2
write singer record, schema and state
JingLin0 Apr 13, 2020
7d4d2c3
delete unused package
JingLin0 Apr 13, 2020
030f947
add ratelimit package
JingLin0 Apr 13, 2020
ea48184
simplify package data
JingLin0 Apr 14, 2020
9a4a7c5
cr: make path adapt to all os by using pathlib
JingLin0 Apr 14, 2020
5c65a62
cr: move session in init function
JingLin0 Apr 14, 2020
e75a9a0
cr: move limit to init
JingLin0 Apr 14, 2020
c17e39d
cr: use int directly
JingLin0 Apr 14, 2020
9a21046
cr: typehint for ms
JingLin0 Apr 14, 2020
89c678c
cr: rewrite logic
JingLin0 Apr 14, 2020
84a5fd5
delete unused import
JingLin0 Apr 14, 2020
0d1c816
cr: add a function for each endpoint and use pagination
JingLin0 Apr 14, 2020
f2809ba
cr: raise error if the function is not implemented
JingLin0 Apr 15, 2020
1142fbd
Merge pull request #10 from dreamdata-io/dry-hubspot
JingLin0 Apr 15, 2020
7779e8c
update replication key
JingLin0 Apr 15, 2020
0a8e9c9
fix up companies endpoint
JingLin0 Apr 15, 2020
4c33da4
include associations
JingLin0 Apr 16, 2020
ff7f71f
fix wrong key properties in schema
JingLin0 Apr 23, 2020
291b42a
add submissions stream
JingLin0 Apr 23, 2020
bf29a89
add submissions schema
JingLin0 Apr 23, 2020
51a1926
get submissions data
JingLin0 Apr 23, 2020
2dd374c
submission pagination and reuse get_replication_value func
JingLin0 Apr 23, 2020
15f8149
Merge pull request #11 from dreamdata-io/get-submission-data
JingLin0 Apr 23, 2020
448baed
transform dash to underscore for schema and record
JingLin0 Apr 25, 2020
50e8e37
only use record_nodash when necessary
JingLin0 Apr 25, 2020
be6a95e
update contacts schema
JingLin0 Apr 25, 2020
c2ab88c
get companyId and dealId according to contact vids
JingLin0 Apr 26, 2020
8814411
add companyId and dealId in contact schema
JingLin0 Apr 26, 2020
9a77e47
do not sync dealId
JingLin0 Apr 27, 2020
64c3cfd
use v3 contacts api
JingLin0 Apr 28, 2020
9b92676
update contacts schema
JingLin0 Apr 28, 2020
1de448a
add ReadTimeout to handle normal timeouts
paddie May 5, 2020
e34c31a
add max_tries=10, so we don't infinitely retry
paddie May 5, 2020
7721e66
refresh token after the first 401
paddie May 5, 2020
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -98,3 +98,9 @@ config.json
.autoenv.zsh
*~
env-vars*
bq_config.json
catalog.json
Pipfile
Pipfile.lock
stream.ndjson
settings.json
53 changes: 19 additions & 34 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,40 +2,25 @@

from setuptools import setup

setup(name='tap-hubspot',
version='2.6.4',
description='Singer.io tap for extracting data from the HubSpot API',
author='Stitch',
url='http://singer.io',
classifiers=['Programming Language :: Python :: 3 :: Only'],
py_modules=['tap_hubspot'],
install_requires=[
'attrs==16.3.0',
'singer-python==5.1.1',
'requests==2.20.0',
'backoff==1.3.2',
'requests_mock==1.3.0',
'nose'
],
entry_points='''
setup(
name="tap-hubspot",
version="2.6.4",
description="Singer.io tap for extracting data from the HubSpot API",
author="Stitch",
url="http://singer.io",
classifiers=["Programming Language :: Python :: 3 :: Only"],
py_modules=["tap_hubspot"],
install_requires=[
"singer-python>=5.1.1, <5.9",
"requests==2.22.0",
"backoff>=1.3.2, <2",
"ratelimit==2.2.1",
],
entry_points="""
[console_scripts]
tap-hubspot=tap_hubspot:main
''',
packages=['tap_hubspot'],
package_data = {
'tap_hubspot/schemas': [
"campaigns.json",
"companies.json",
"contact_lists.json",
"contacts.json",
"deals.json",
"email_events.json",
"forms.json",
"keywords.json",
"owners.json",
"subscription_changes.json",
"workflows.json",
],
},
include_package_data=True,
""",
packages=["tap_hubspot"],
package_data={"tap_hubspot/schemas": ["*.json"]},
include_package_data=True,
)
Loading