Skip to content

UaExporter helps you export your Universal Analytics data to your own datasources, including CSV and Clickhouse.

License

Notifications You must be signed in to change notification settings

jsanroman/uaexporter

Repository files navigation

📊 UaExporter

⚠️ Important Notice: Universal Analytics (UA) properties stopped processing new hits on 1 July 2023, and the UA API is scheduled to stop working on 1 July 2024. To preserve your metrics, it is crucial to export your data. For more detailed information, please visit the Google support page at https://support.google.com/analytics/answer/11583528?hl=en.

UaExporter helps you export your Universal Analytics data to your own datasources, including CSV and Clickhouse.

Configuration

1. Environment Variables

Update the .env file with your specific configurations for Clickhouse/CSV connectors and Google Analytics settings.

2. Define Your Reports

Customize reports.yml to define the specifics of the data you want to export:

  • name: The name of your report, which also serves as the csv file name or database table name.
  • connector: Choose between csv and clickhouse.
  • start_date: The starting date for the data export.
  • end_date: The ending date for the data export.
  • metrics: Specify the metrics from Universal Analytics, e.g., ga:pageviews.
  • dimensions: Define the dimensions to include, e.g., ga:pagePath,ga:date.
  • split_requests_by: If you have sampling issues, set this property to day or month and make one request per day or month.

Use the Google Analytics Query Explorer (https://ga-dev-tools.appspot.com/query-explorer/) to prototype and test your queries with customm metrics and dimensions.

Usage

In your own environment

Install the required Python packages:

pip install --progress-bar off -r requirements.txt

Execute the uaexporter script:

./uaexporter

Ensure that uaexporter has the necessary execution permissions: chmod +x uaexporter

Using Docker

Build the Docker image:

docker build -t uaexporter .

Run the uaexporter container:

docker run uaexporter

Using Docker Compose to start clickhouse server too

Build the services defined in your docker-compose.yml:

docker-compose build

Start the services:

docker-compose up

Execute uaexporter within the running container:

docker-compose exec uaexporter ./uaexporter

About

UaExporter helps you export your Universal Analytics data to your own datasources, including CSV and Clickhouse.

Topics

Resources

License

Stars

Watchers

Forks