etlhelp Tag Posts Index

Spark Scala: Grouping Values In A Key-Value Pair

First, we'll create our data set. We'll notice in our test data set, we have different uni values in various IDs. Ultimately, we'd like to get these outputted in

Quick ETL Hacks With PowerShell

Get Number of Fields And Values In A Delimited File This is extremely useful if we need to get every 124th value (or another Nth value) from every line in a delimited

Spark Join Hacks With Scala

Only because I tend to come back to these over and over again, here's some join hacks with Scala in Spark: Reference 'Column' Is Ambiguous, Could Be 'Column', 'Column'

Maven Build Project Without Unit Tests and Reporting Errors

Just a quick hack to remember what commands to use during builds with Maven: CommandResult mvn clean packageClears the directory, builds the packages, and runs unit