Category: Tech
-
Using Apache NiFi to send data to Tinybird
NiFi is a fantastic way to move data, and its ridiculously easy to use NiFi to send data to Tinybird.
-
My take on Developer Experience
Developer Experience does not mean ‘does this look pretty’ nor ‘does this solve a problem’. It means ‘does this help you solve the problem’.
-
Using CloudFlare Workers for Twitter webhooks: Part 1, Twitter CRC
Implementing the Twitter Challenge-Response Checks with CloudFlare Workers.
-
My first docs site, from scratch: the ClickHouse Knowledge Base
Building great docs is not easy. This is how I approached building Tinybird’s ClickHouse Knowledge Base.
-
Serverless Webhooks & Analytics with Cloudflare Workers & Tinybird
Creating your first Cloudflare Worker to forward posts from Ghost to Discord, with Analytics in Tinybird.
-
Introducing dbt-impala
As part of my new role at Cloudera, I have been looking at a tool called dbt. To many, dbt needs no introduction – it has not just made a splash in the data ecosystem, it has come in riding a tsunami of positivity, and for good reason! Just looking at it’s star history we […]
-
Getting started with NiFi’s ScriptedReader by processing Key Value Pairs – Part 1
Records have become an integral part of working with NiFi since their introduction on May 8th, 2017 with the release of NiFi 1.2.0. They allow us to treat our data as more than just a bunch of bytes, giving NiFi the ability to better understand and manipulate common data formats used by other tools. However, […]
-
NiFi Terminology Basics
This post is going to cover the basic terminology that you’ll need to know for working with NiFi. Canvas The Canvas is the free grid space on which you create your Flow. It is accessed through the NiFi Web UI. You build Flows by dragging Processors on to the Canvas. Controller Service A Controller Service […]
-
S3 Event Notifications in NiFi
The desire to pull newly uploaded files from storage is common, and typically the ListFile -> FetchFile pattern has been used in NiFi to monitor for, and then pull, new files as they arrive. Taking NiFi in to the cloud means that we’re often working with cloud object storage, like Amazon S3. While we can […]
-
Installing NiFi 1.14.0 on Linux (non-production)
This post is going to walk through installing the latest release of NiFi on a Linux host (Fedora). This latest release is version 1.14.0 and an important change is that NiFi is now secure by default. This means that HTTPS is enabled out of the box (with self signed certs), user authentication is required and […]