This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.
Tag: data pipeline
-
#datapipeline: Deploy Serverless Data pipeline to GCP with Terraform
I recently built a data pipeline which I wrote up in an article data pipeline the hourly electricity rate, what I did not explain was how I deployed it to the Google Cloud Platform. In this article, I will show you how I used Terraform to deploy it to the Google Cloud Platform. The biggest…
-
#Datapipeline: The T in ETL with SQL
If you read this I assume you are familiar with Extract Transform and Load (ETL), this is just a short article to show how you can do ETL and especially T, the transform using a SQL statement.
-
List of datasets for all your data science work
Data science is a hot topic just now, more and more people are talking about it and planning to include data science in their organizations. The data science practice is to extract knowledge and insights from data and information generated through various tools and applications.
-
List of modern data stack technologies for your modern data stack
We have created a list of modern data stack technologies. The Modern Data Stack technologies are mostly SaaS-based technologies that comprise runs on a cloud-native data platform, generally leveraged to reduce the complexity in running a traditional data platform. The goal with the Modern Data Stack is to make data actionable by reducing the time…
-
The Swedish Electricity Pricing Explained
I recently started digging into electricity prices and how electricity price is in Sweden, I wrote an article on how I built a data pipeline to get an email report sent to me daily with the latest hourly electricity price. The article #datapipeline the hourly electricity rate shows you how the data pipeline was built.
-
#datapipeline the hourly electricity rate
I spent my Christmas holiday in the southern part of Sweden, the weather was cold with several days of temperatures down under -10 celsius. In the news were stories about new price records for a KwH of electricity. I started to get worried that our electricity bill for December or for the whole winter period…
-
Data Project: Python with Google Analytics API
In this article, I will take you through the details of writing a Python Notebook code to extract data from Google Analytics (GA4) using the Google API Python library to access Google Analytics.
-
Data project: I became an environmental data collector
At the beginning of the Corona epidemic, I wrote an article about a personal data project I had worked on: The air I breathe how polluted is it?. After that project, I became an environmental data collector by purchasing a wearable, portable indoor-outdoor air quality monitor. My interest in air quality is about the fact that…
-
Data Project: Splitting addresses with Google Cloud Dataprep
This article is part of the article I wrote about how I became an environmental data collector, and the issue I run into during the project and how I finally resolved them. After I collected the data with the wearable, portable indoor-outdoor air quality monitor Atmotube PRO.