Now that I have gone over how I built an ETL job using KIBA, let’s look at how I leverage Github Actions to run the jobs on a daily basis. Setting Up Environments As I continue to redesign buyanddefi.com, I want to set up different environments to test my etl code and other…

In my last post, I showed how I collected Earn information from Binance US’s website using Mechanize. Now with the data captured, how do I load it to a database that my website, buyanddefi.com, can use? What is KIBA? Kiba is an ETL framework written in ruby that makes it…

Just like interest rates, staking/defi rates change periodically. Collecting and entering this information from different crypto exchange websites manually can be a painstaking task. Unfortunately, very few crypto exchanges provide an API to collect that information. So, I decided to write a page scraper to collect the data and…

During the development of a new app environment with terraform, I was reviewing the dev environment and asked a question to my DevOps engineer: How Do I Know That This Environment Is Functional? The first answer I received was to call the “alive” endpoint and check for a status code…

Over a year ago, Disneyland closed its gates because of the pandemic. Not only did the park close, but it put an end to the Disneyland Annual Pass. After reopening on April 30, details of the new annual pass program have not been made publicly available as of this post. …

If you are like me, then you have given a majority of your friends and family a gift card for various occasions. I actually got into the habit of grabbing a gift card every time I was at the grocery, just so that one was available when I needed it…

“How easy is it to build a QR Code Generating Website?” After 3 weeks adhering to California’ Shelter in Place mandate, this message from a colleague was refreshing. I quickly responded to him saying that it was relatively easy to build. …