Pulling from public XML/API data sources for SSIS?

  • Hello all, I am in the process of building an experimental database for reporting purposes and would like to download comprehensive datasets. I thought Google Analytics data would be ideal for this purpose. Can someone give me some advice as to where to begin accessing this data? From what I understand, Google makes this data publicly available as API. What would I need to access this API and convert this data into XML, before transforming and inputting into my tables using SSIS? Thanks in advance

  • Not sure if this will help. I used a WMI connection to get map info from google.

    Ian Cockcroft
    MCITP BI Specialist

  • Thank you, I will look into WMI Data Reader Task functionality to see if this can aid with my goal. But more generally, I was seeing if I could understand, at least conceptually if not through SSIS, how pulling from an API works? A good example of a API/XML source I found is here:

    http://developer.nytimes.com/docs/congress_api/

    Where could I begin if I wanted to set up a data flow to pull this as my data source? Just extraction, the transforming and loading shouldn't be hard to figure out after that. Can it be done through SSIS?

  • Google Analytics provide many dataset. I am not sure what kind of dataset you have been looking for. But if you want to pull the information using SSIS, you have to use Google Analytics API. In SSIS you can use .NET code to pull the piece of information from Google Analytics API.

    Here are few links that you can refer. The samples are in .NET so you might have to tailor it as per SSIS.

    How to get started with Google Analytics API?

    Google Analytics API with .NET How to pull Search Engine statistics with Google Analytics?.

    Google Analytics API with .NET How to pull Visitor Type statistics with Google Analytics?

    How to pull your web site speed statistics from Google Analytics?

    Vikash Kumar Singh || www.singhvikash.in

  • very cool. thanks

    Ian Cockcroft
    MCITP BI Specialist

  • Hello,

    We are having SSIS Google Analytics Source[/url] connector ,that can be used to read data from Google Analytics Service without learning complex APIs. Easy to use interface allows you extract large amount of data adjusting parameters such as dimensions, metrics, filters, sortby, date range etc. You can also use inbuilt reports or specify direct query URL to get desired data. There are some extra feature of this package that I am going to mention here

    1. Intuitive user interface makes google analytics data integration super easy and fast without learning complex APIs or scripting language

    2. Support for OAuth 2.0 Authentication and Google service account (*.p12 certificate file)

    3.Support for Proxy Server

    4. Easy to use interface with three different ways to query google analytics data (1) Build query from UI (2) Use built in query templates (3) Use direct query

    5.Support for dynamic dimensions, metrics, segments, filters and sortby fields (e.g. supply these values at runtime)

    6.Live preview support at design time

    7.Support for AdWords, AdSense, Ad Exchange and DoubleClick for Publisher (DFP)

    If you need more help ,We are having sample work of this and we also have shared video where task is explained that how to work with this. I am sharing URL here. Please Have a look.

    http://zappysys.com/products/ssis-powerpack/ssis-google-analytics-source-connector/

    🙂

    SSIS Json source[/url] : The Json file soure is used to to read data from Json file. We have mentioned source code with example.

  • This was removed by the editor as SPAM

Viewing 7 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply