Menu

Close
  • Home
Subscribe
Menu

Kyle Valade

34 posts
Page 1 of 2 Older Posts →

This one simple trick lets you stream with dbt and Databricks

Are you using Databricks and want to use dbt, but you're not sure how to do it with all of your big data? Like, dbt can't »

Kyle Valade 19 November 2025

Automating tedium with the ServiceNow API

I should have named this blog Enterprise . But big companies are going to use ServiceNow whether or not HR likes handling onboarding tickets in the side-project »

Kyle Valade 12 January 2024

Eternities of Gitlab CI pipeline trial + error...only run with changes

I've spent many mind-numbing hours trying to get this Gitlab CI pipeline to work the way I want it to work. I'm not sure if I'm »

Kyle Valade 03 April 2023

Jest - mock a single function in a module

Though the requireActual route looked promising, it only worked when I called the mocked function directly in my test, and not when used like in real »

Kyle Valade 14 December 2022

MLOps, CI, and development flows using Databricks

I wrote this about a year or two ago while I was still working a lot with Databricks. It was right around the time where "MLOps" »

Kyle Valade 04 February 2021

In Soviet Russia, ad finds you

This is a post I wrote for work to explain the basics and foundations of ad tracking. It was meant for a fairly nontechnical audience, so »

Kyle Valade 28 February 2020

ODBC and DB2 - problem saving a large chunk of text - CWBNL0107

I'm using PyODBC to connect to DB2 and was seeing some problems saving certain rows of data. The column the error message mentioned was a CLOB »

Kyle Valade 30 January 2020

Connect to DB2 from python with SQLAlchemy

This is kind of a sister post to my Databricks-specific post from the other day. It's amazing how much time you can spend searching through docs, »

Kyle Valade 22 January 2020

Access DB2 From Databricks

This took me a good few hours to figure out. So hopefully it will help you and my future self. install com.ibm.db2.jcc:db2jcc: »

Kyle Valade 16 January 2020

7x performance improvement for my dead slow SQL Server + Django pyodbc queries

In one of my Django projects, I'm connecting to a SQL server database, and I'm doing this with django-pyodbc-azure. I noticed that my query performance was »

Kyle Valade 06 December 2019

Django in Azure Web Apps - too many redirects

I've been testing out Azure Web App services lately so I can avoid all of the reverse proxy/server management mumbo jumbo. When I was deploying »

Kyle Valade 25 October 2019

Working with SQL Server in Django pt. II

This is a follow-up and brutal takedown of a post I wrote about two years ago. Go here for part I. I'm starting to use Django »

Kyle Valade 16 October 2019

Calculate grouped YTD totals for previous years in Pandas

I want to calculate the YTD total for the last couple years for every customer + product combination that has been sold. I'm new to Pandas and »

Kyle Valade 01 August 2019

Import a directory into Databricks using the Workspace API in Python

Another fairly easy thing that I couldn't find in the docs. I wanted to be able to upload a directory into my Databricks Workspace from my »

Kyle Valade 07 June 2019

Read from SQL Server with Python/Pyspark in Databricks

This is actually really easy, but not something spelled out explicitly in the Databricks docs, though it is mentioned in the Spark docs. Alas, SQL server »

Kyle Valade 05 June 2019

Parse XML with PySpark in Databricks

It's kind of a trick title, but here's the answer: don't. Just don't do it. Python is no good here - you might as well drop »

Kyle Valade 25 February 2019

Logging with Sentry on Databricks

I couldn't find anything that laid this out really plainly, so I'm going to do so here. I'll update as I learn more and dig deeper, »

Kyle Valade 18 January 2019

Application is not supported over the /common or /consumers endpoints. Please use the /organizations or tenant-specific endpoint.

I was getting this error message when trying to sign into Azure Active Directory in a .Net Core 2.x app. It was written by someone »

Kyle Valade 17 July 2018

The Trials and Tribulations of a Database Context in .NET Core (pt. 1)

When I started using .NET Core this time around, I was pleasantly surprised. But over the past couple of days, I have been unpleasantly surprised. There »

Kyle Valade 11 May 2018

Dependency injection in .NET Core 2.0

Say I have a controller and I want it to pull something from Amazon. Say that I also have unit tests and I don't want to »

Kyle Valade 09 March 2018
Page 1 of 2 Older Posts →
Nightly Closures © 2025
Proudly published with Ghost