pytrends

Introduction

Unofficial API for Google Trends

Allows simple interface for automating downloading of reports from Google Trends. Main feature is to allow the script to login to Google on your behalf to enable a higher rate limit. Only good until Google changes their backend again :-P. When that happens feel free to contribute!

Table of contens

• Installation

• API

  • API Methods

  • Common API parameters

    • Interest Over Time
    • Interest by Region
    • Related Queries
    • Trending Searches
    • Top Charts
    • Suggestions

  • Caveats

• Credits

Installation

pip install pytrends

Requirements

• Written for both Python 2.7+ and Python 3.3+
• Requires a google account to use.
• Requires BeautifulSoup4, Requests, lxml, Pandas

_{^{back to top}}

API

Connect to Google

pytrends = TrendReq(google_username, google_password, hl='en-US', tz=360, custom_useragent=None)

Parameters

• google_username

  • Required
  • a valid gmail address

• google_password

  • Required
  • password for the gmail account

Build Payload

pytrends = build_payload(kw_list, cat=0, timeframe='today 5-y', geo='', gprop='')

Parameters

• kw_list

  • Required
  • Keywords to get data for

_{^{back to top}}

API Methods

The following API methods are available:

• Interest Over Time: returns historical, indexed data for when the keyword was searched most as shown on Google Trends' Interest Over Time section.

• Interest by Region: returns data for where the keyword is most searched as shown on Google Trends' Interest by Region section.

• Related Queries: returns data for the related keywords to a provided keyword shown on Google Trends' Related Queries section.

• Trending Searches: returns data for latest trending searches shown on Google Trends' Trending Searches section.

• Top Charts: returns the data for a given topic shown in Google Trends' Top Charts section.

• Suggestions: returns a list of additional suggested keywords that can be used to refine a trend search.

_{^{back to top}}

Common API parameters

Many API methods use the following:

• kw_list

  • keywords to get data for

  • Example ['Pizza']

  • Up to five terms in a list: ['Pizza, Italian, Spaghetti, Breadsticks, Sausage']

    • Advanced Keywords

      • When using Google Trends dashboard Google may provide suggested narrowed search terms.
      • For example "iron" will have a drop down of "Iron Chemical Element, Iron Cross, Iron Man, etc".
      • Find the encoded topic by using the get_suggestions() function and choose the most relevant one for you.
      • For example: https://www.google.com/trends/explore#q=%2Fm%2F025rw19&cmpt=q
      • "%2Fm%2F025rw19" is the topic "Iron Chemical Element" to use this with pytrends
      • You can also use pytrends.suggestions() to automate this.

• hl

  • Language to return result headers in
  • Two letter language abbreviation
  • For example US English is 'en-US'
  • Defaults to US english

• cat

  • Category to narrow results
  • Find available cateogies by inspecting the url when manually using Google Trends. The category starts after cat= and ends before the next &
  • For example: "https://www.google.com/trends/explore#q=pizza&cat=71"
  • '71' is the category
  • Defaults to no category

• geo

  • Two letter country abbreviation
  • For example United States is 'US'
  • Defaults to World
  • More detail available for States/Provinces by specifying additonal abbreviations
  • For example: Alabama would be 'US-AL'
  • For example: England would be 'GB-ENG'

• tz

  • Timezone Offset
  • For example US CST is '360'

• timeframe

  • Date to start from

  • Defaults to last 5yrs, 'today 5-y'.

  • Everything 'all'

  • Single year, 'all_2008'

  • Specific dates, 'YYYY-MM-DD YYYY-MM-DD' example '2016-12-14 2017-01-25'

  • Current Time Minus Time Pattern:

    • By Month: 'today #-m' where # is the number of months from that date to pull data for

      • For example: 'today 61-m' would get data from today to 61months ago
      • NOTE Google uses UTC date as 'today'

    • Daily: 'now #-d' where # is the number of days from that date to pull data for

      • For example: 'now 7-d' would get data from the last week

    • Hourly: 'now #-H' where # is the number of hours from that date to pull data for

      • For example: 'now 1-H' would get data from the last hour

• gprop

  • What Google property to filter to
  • Example 'images'
  • Defaults to web searches
  • Can be images, news, youtube or froogle (for Google Shopping results)

• custom_useragent

  • name to identify requests coming from your script

_{^{back to top}}

Interest Over Time

pytrends.interest_over_time()

Returns pandas.Dataframe

_{^{back to top}}

Interest by Region

pytrends.interest_by_region(resolution='REGION')

Parameters

• resolution

  • 'CITY' returns city level data
  • 'REGION' returns country level data

Returns pandas.DataFrame

_{^{back to top}}

Related Queries

pytrends.related_queries()

Returns dictionary of pandas.DataFrames

_{^{back to top}}

Trending Searches

pytrends.trending_searches()

Returns pandas.DataFrame

_{^{back to top}}

Top Charts

pytrends.topcharts(date, cid, geo='US', cat='')

Parameters

• date

  • Required
  • YYYYMM integer or string value
  • Example '201611' for November 2016 Top Chart data

• cid

  • Required
  • Topic to get data for
  • Only able to choose from those listed on https://www.google.com/trends/topcharts
  • Example the chart 'Baseketball players cid is 'basketball_players'

Returns pandas.DataFrame

_{^{back to top}}

Suggestions

pytrends.suggestions(keyword)

Parameters

• keyword

  • Required
  • keyword to get suggestions for

Returns dictionary

_{^{back to top}}

Caveats

• This is not an official or supported API
• Google may change aggregation level for items with very large or very small search volume
• Google will send you an email saying that you had a new login after running this.
• Rate Limit is not pubically known, let me know if you have a consistent estimate.

Credits

• Major JSON revision ideas taken from pat310's JavaScript library

  • https://github.com/pat310/google-trends-api

• Connecting to google code heavily based off Stack Overflow post

  • http://stackoverflow.com/questions/6754709/logging-in-to-google-using-python

• With some ideas pulled from Matt Reid's Google Trends API

  • https://bitbucket.org/mattreid9956/google-trend-api/overview