Noah KennedyinStackademicSpark Performance Tuning for BigQuery APIsAt the end of 2023, my team was given an important initiative — run a Natural Language Processing (NLP) algorithm on about a billion pages…7 min read·Mar 26, 2024----
Noah KennedyinStackademicReducing BigQuery Costs by 100–200x with dbt Incremental ModelsMany models my team works with at Tempus are large, but not “big data” large. Usually, our tables hover around the hundred-million rows…8 min read·Feb 7, 2024--1--1
Noah KennedySeveral Examples of Why AI Is Not Going to Replace Our JobsAnytime soon at least. Disclaimer: this article is not serious.3 min read·Jan 31, 2024----
Noah KennedyinStackademicThree Key BigQuery Optimizations We Should All Be UsingDuring a recent BigQuery debugging session, I dove deep into BigQuery and learned a few important lessons that I believe are not well-known…6 min read·Jan 9, 2024--4--4
Noah KennedyDebug Diaries: duplicate records in dbt SnapshotsHi, my name is Noah — I’m a Senior Data Engineer at Tempus AI. I write about the tech challenges I face with the hope of creating that…5 min read·Dec 14, 2023----
Noah KennedyinStackademicSQL and dbt 101I volunteer on the Tempus Board of Education (TBOE) in my free time. TBOE is a group that aims to provide Tempus employees with courses and…5 min read·Nov 20, 2023--3--3
Noah KennedyElementary on dbt — An OverviewIf you’ve read my previous articles, you’ll know that I’m a dbt evangelist and a huge advocate of the importance of proper testing…4 min read·Nov 8, 2023----
Noah KennedyFour Simple Frameworks to Improve Communication Skills as an EngineerFrameworks to help you be a more effective communicator, and therefore a more effective Individual Contributor (IC).5 min read·Oct 31, 2023--1--1
Noah KennedyThree dbt Macros I Use Every DayLast month my team here at Tempus built out a new data mart using our normal tech stack of SQL + AirFlow + dbt in GCP, and I realized that…5 min read·Jul 20, 2023--1--1
Noah KennedyCreating Parameterized Spark Jobs on Ephemeral DataProc ClustersOn-demand spark jobs with DataProc helps to democratize spark jobs. For a while, the common and accessible options were running Spark…4 min read·Mar 2, 2023--1--1