Google Big Query Storage API Benchmark
How to Benchmark and Increase the Performance of BigQuery Using the BQ Storage API Why BQ Storage API? Google Big Query (BQ) is a serverless, highly scalable and cost-effective Cloud Data [...]
Data-engineering Insights
Solving the World's Unsolved Problems
Auto Scale EMR to Unleash Business Analysts’ Capabilities
Auto Scale EMR: Enables Analysts to Cut Through the Flood of Data Introduction Business analysts are increasingly tasked to analyze large volumes of analytic data and share insights to hel [...]
Elastic Airflow for Managing Cloud Data Workloads
Elastic Airflow: A utility that accelerates job processing by scaling the workers in congruence with workload Introduction Data analytics and automation is the current need of business pro [...]
Scaling out Airflow with Celery and RabbitMQ to Orchestrate ETL Jobs on the Cloud
AIRFLOW WORKFLOWS AND THE CLOUD "Airflow is a platform to programmatically author, schedule, and monitor workflows" Airflow allows you to author workflows by creating tasks in a Direct Acy [...]