Noah Kennedy – Medium

Noah Kennedy
in
Stackademic

Spark Performance Tuning for BigQuery APIs

At the end of 2023, my team was given an important initiative — run a Natural Language Processing (NLP) algorithm on about a billion pages…

7 min readMar 26, 2024

--

Spark Performance Tuning for BigQuery APIs

--

Noah Kennedy
in
Stackademic

Reducing BigQuery Costs by 100–200x with dbt Incremental Models

Many models my team works with at Tempus are large, but not “big data” large. Usually, our tables hover around the hundred-million rows…

8 min readFeb 7, 2024

--

1

Reducing BigQuery Costs by 100–200x with dbt Incremental Models

--

1

Noah Kennedy

Several Examples of Why AI Is Not Going to Replace Our Jobs

Anytime soon at least. Disclaimer: this article is not serious.

3 min readJan 31, 2024

--

Several Examples of Why AI Is Not Going to Replace Our Jobs

--

Noah Kennedy
in
Stackademic

Three Key BigQuery Optimizations We Should All Be Using

During a recent BigQuery debugging session, I dove deep into BigQuery and learned a few important lessons that I believe are not well-known…

6 min readJan 9, 2024

--

4

Three Key BigQuery Optimizations We Should All Be Using

--

4

Noah Kennedy

Debug Diaries: duplicate records in dbt Snapshots

Hi, my name is Noah — I’m a Senior Data Engineer at Tempus AI. I write about the tech challenges I face with the hope of creating that…

5 min readDec 14, 2023

--

Debug Diaries: duplicate records in dbt Snapshots

--

Noah Kennedy
in
Stackademic

SQL and dbt 101

I volunteer on the Tempus Board of Education (TBOE) in my free time. TBOE is a group that aims to provide Tempus employees with courses and…

5 min readNov 20, 2023

--

3

SQL and dbt 101

--

3

Noah Kennedy

Elementary on dbt — An Overview

If you’ve read my previous articles, you’ll know that I’m a dbt evangelist and a huge advocate of the importance of proper testing…

4 min readNov 8, 2023

--

Elementary on dbt — An Overview

--

Noah Kennedy

Four Simple Frameworks to Improve Communication Skills as an Engineer

Frameworks to help you be a more effective communicator, and therefore a more effective Individual Contributor (IC).

5 min readOct 31, 2023

--

1

Four Simple Frameworks to Improve Communication Skills as an Engineer

--

1

Noah Kennedy

Three dbt Macros I Use Every Day

Last month my team here at Tempus built out a new data mart using our normal tech stack of SQL + AirFlow + dbt in GCP, and I realized that…

5 min readJul 20, 2023

--

1

Three dbt Macros I Use Every Day

--

1

Noah Kennedy

Creating Parameterized Spark Jobs on Ephemeral DataProc Clusters

On-demand spark jobs with DataProc helps to democratize spark jobs. For a while, the common and accessible options were running Spark…

4 min readMar 2, 2023

--

1

Creating Parameterized Spark Jobs on Ephemeral DataProc Clusters

--

1

Noah Kennedy

Noah Kennedy

Senior Data Engineer at Tempus AI. All opinions are my own. Easily excited, mainly by topics from dbt, to endurance sports, to pour-overs, to biotech trends.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams