This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.
Category: Software Development
-
#dataset: Creating a dataset using an API with Python
For any data analytics project I do, the first thing that I need is a dataset. I have put together a list of online datasets that you can use for your various analytics, there are sometimes you wish to extract data on your own and begin your own investigation.
-
What is reverse ETL and why do you need it
Reverse ETL empowers data teams to easily prep bulk data, move it outside the cloud data warehouse, and operationalize it for their organization. Data is helpful, but its actual value is only realized when it is made actionable.
-
What is Reverse ETL?
The data engineering industry has evolved from Extract, Transform, Load (ETL) to ELT, where raw data is copied from the source system loaded into a data warehouse or data lake and then transformed. The current trend is to adopt a new approach, called “reverse ETL,” the process of moving data from a data warehouse into third-party…
-
#datapipeline: Deploy Serverless Data pipeline to GCP with Terraform
I recently built a data pipeline which I wrote up in an article data pipeline the hourly electricity rate, what I did not explain was how I deployed it to the Google Cloud Platform. In this article, I will show you how I used Terraform to deploy it to the Google Cloud Platform. The biggest…
-
#Datapipeline: The T in ETL with SQL
If you read this I assume you are familiar with Extract Transform and Load (ETL), this is just a short article to show how you can do ETL and especially T, the transform using a SQL statement.
-
A Historic perspective of how SaaS has simplified software delivery
If you have read my previous article, 23360 days old and counting, you know that I have been around the software industry for a while. In my early days, I worked for Philips Telecommunication, a global IT company in the 1980s that delivered a turnkey solution from hardware, operating system to client software for their…
-
How Environmental Friendly is Programming Languages
One thing that I have wondered about for a while is which programming language is the most environmentally friendly for the climate. Over my career, I have used many different programming languages, starting with Assembly as we build Operating Systems and working very closely with the hardware. Over the years, I got away from working…
-
How to Prevent Your Tech from Turning Against You
Soaring through the 21st century, we are swamped with technology. From your personal computer, your eBook reader and your smartphone, you are subjected to an always-online system 24/7. In addition, the advent of the smart home means devices like hubs communicate with your temperature controls, light bulbs and refrigerator. But appliances break down, yet there…
-
Demystifying Blockchain
Imagine a blockchain as a digital ledger or a record book used to track transactions. This ledger is not stored in one place but is duplicated across a network of computers.
-
#Throwback tales: Efficiency improvement to make in your business
I have been around the software industry for over 40 years, and there are a few things I learnt and I dislike about companies are operates, I am not a fan of meetings, bureaucracy, hierarchy, or any system that obstructing immediate communication.