How to Build Pivot Tables in BigQuery Fast and Easy
A Fast Approach to Building Pivot Table / Transpose Functionality into BigQuery Background Transposing or pivoting a table is a common operation in data analysis, however, BigQuery does no [...]
Data-engineering Insights
Solving the World's Unsolved Problems
SAS Grid Performance Benchmarking with Lustre and SPDS on Microsoft Azure
How to Benchmark the Performance of a SAS Cloud Migration using Lustre & SPDS on Microsoft Azure Background As organizations migrate analytic workloads to the cloud, their roadmap need [...]
Google Big Query Storage API Benchmark
How to Benchmark and Increase the Performance of BigQuery Using the BQ Storage API Why BQ Storage API? Google Big Query (BQ) is a serverless, highly scalable and cost-effective Cloud Data [...]
Auto Scale EMR to Unleash Business Analysts’ Capabilities
Auto Scale EMR: Enables Analysts to Cut Through the Flood of Data Introduction Business analysts are increasingly tasked to analyze large volumes of analytic data and share insights to hel [...]
Elastic Airflow for Managing Cloud Data Workloads
Elastic Airflow: A utility that accelerates job processing by scaling the workers in congruence with workload Introduction Data analytics and automation is the current need of business pro [...]
Scaling out Airflow with Celery and RabbitMQ to Orchestrate ETL Jobs on the Cloud
AIRFLOW WORKFLOWS AND THE CLOUD "Airflow is a platform to programmatically author, schedule, and monitor workflows" Airflow allows you to author workflows by creating tasks in a Direct Acy [...]