SlideShare a Scribd company logo
Augmentation of bids for
programmatic ad auctions @ real
time with the power of Reactive
Architecture
Sumit Srivastava
Engineering Lead - MiQ
2
❑ Marketing intelligence and Analytics
partner to many of the world’s most
prominent brands and media agencies
American Express, Avis, Lenovo,
Unilever, Microsoft, GroupM, Publicis
and IPG.
❑ AiQ is our technology that provides
modular, API-based analytics services
to rapidly build data solutions for
successful real-time business outcomes.
MiQ - Activating Marketing Intelligence via AiQ
Data Scientists & Engineers
Data Scientists & Analysts
Solution Engineers & Traders
3
Daily Scale @ MiQ
80 Billion Ad
Impressions
5000+
Strategies
10+TB
Data1000+
Campaigns
750
million
users
Insights
Data mutation &
copies
Security Scale
● #campaigns
● #no. of people
● varied experience
levels
Quality
Multiple
languages &
tools
4
The system
35 million
IP range records that we store in
PostgreSQL, each consisting respective
Geo information
35+
Features (parameters) each bid request
is evaluated upon
100ms
Average lifetime of an ad request
including bidding, campaign
optimization and creative delivery
7+TB
Amount of compressed data generated
every day
90%
Gateway to the exchange for MiQ
campaigns
Marketing Intelligence
Source to the data powering the core of
data science at MiQ
5
❑ 1.5 million requests per second
❑ Response time below 10ms
❑ IP to Geo resolution
The problem statement
6
The solution
7
The journey
Version One Version Two
Components ● In-house Netty based server
● Off-heap pagination driven custom
data structure
● Vert.x
● PostgreSQL
Advantages ● Customized to have extremely low
memory footprint
● Non-blocking
● Low maintenance
● Highly scalable
● Active community
Disadvantages ● High maintenance
● Blocking
● Not scalable
● Complex debug process
● Readability
● No community support
● Slightly higher memory footprint
8
Stats
❑ Requests per server: (10 connections, 10 threads)
● 200k/sec with no lookup data
● 25+k/sec with all features loaded
❑ Average response time: 4ms (95%)
❑ PostgreSQL queries response: <=2ms (99%)
9
Q&A
10
Thank You
Ad

More Related Content

What's hot (10)

Event Mesh: the Architecture Layer That Will Make Your Business Event-Driven
Event Mesh: the Architecture Layer That Will Make Your Business Event-DrivenEvent Mesh: the Architecture Layer That Will Make Your Business Event-Driven
Event Mesh: the Architecture Layer That Will Make Your Business Event-Driven
Solace
 
Deview2012 키노트 #2
Deview2012 키노트 #2Deview2012 키노트 #2
Deview2012 키노트 #2
NAVER D2
 
Getting More Value from your Cloud Data Assets
Getting More Value from your Cloud Data AssetsGetting More Value from your Cloud Data Assets
Getting More Value from your Cloud Data Assets
Eliot Arnold
 
Banking of the Future_Nitin_v3
Banking of the Future_Nitin_v3Banking of the Future_Nitin_v3
Banking of the Future_Nitin_v3
Nitin Thukral
 
Melodic Keynote presentation at OW2con'19, June 12-13, Paris.
Melodic Keynote presentation at OW2con'19, June 12-13, Paris. Melodic Keynote presentation at OW2con'19, June 12-13, Paris.
Melodic Keynote presentation at OW2con'19, June 12-13, Paris.
OW2
 
Monika solanki-agrisemantics2021
Monika solanki-agrisemantics2021Monika solanki-agrisemantics2021
Monika solanki-agrisemantics2021
Monika Solanki
 
Mimir pitch deck oct18
Mimir pitch deck oct18Mimir pitch deck oct18
Mimir pitch deck oct18
Andrew Cockburn
 
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Big Data Spain
 
Big data Abstract
Big data AbstractBig data Abstract
Big data Abstract
Liodegar Bracamonte
 
The RIC Group WMS
The RIC Group WMSThe RIC Group WMS
The RIC Group WMS
The RIC Group
 
Event Mesh: the Architecture Layer That Will Make Your Business Event-Driven
Event Mesh: the Architecture Layer That Will Make Your Business Event-DrivenEvent Mesh: the Architecture Layer That Will Make Your Business Event-Driven
Event Mesh: the Architecture Layer That Will Make Your Business Event-Driven
Solace
 
Deview2012 키노트 #2
Deview2012 키노트 #2Deview2012 키노트 #2
Deview2012 키노트 #2
NAVER D2
 
Getting More Value from your Cloud Data Assets
Getting More Value from your Cloud Data AssetsGetting More Value from your Cloud Data Assets
Getting More Value from your Cloud Data Assets
Eliot Arnold
 
Banking of the Future_Nitin_v3
Banking of the Future_Nitin_v3Banking of the Future_Nitin_v3
Banking of the Future_Nitin_v3
Nitin Thukral
 
Melodic Keynote presentation at OW2con'19, June 12-13, Paris.
Melodic Keynote presentation at OW2con'19, June 12-13, Paris. Melodic Keynote presentation at OW2con'19, June 12-13, Paris.
Melodic Keynote presentation at OW2con'19, June 12-13, Paris.
OW2
 
Monika solanki-agrisemantics2021
Monika solanki-agrisemantics2021Monika solanki-agrisemantics2021
Monika solanki-agrisemantics2021
Monika Solanki
 
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Big Data Spain
 

Similar to Augmentation of bids for programmatic ad auctions @ real time with the power of Reactive Architecture - Sumit srivastava (MIQ) (20)

Next-Gen уже здесь
Next-Gen уже здесьNext-Gen уже здесь
Next-Gen уже здесь
CEE-SEC(R)
 
Podcasters and Advertisers Marketplace on Blockchain
Podcasters and Advertisers Marketplace on BlockchainPodcasters and Advertisers Marketplace on Blockchain
Podcasters and Advertisers Marketplace on Blockchain
Cygnet Infotech
 
ParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream - Big Data for Business Users
ParStream - Big Data for Business Users
ParStream Inc.
 
Tech Mpire (TMP) - Product Presentation - July 2017
Tech Mpire (TMP) - Product Presentation - July 2017 Tech Mpire (TMP) - Product Presentation - July 2017
Tech Mpire (TMP) - Product Presentation - July 2017
George Gabriel
 
Monetizing the Internet of Things: Creating a Connected Customer Experience
Monetizing the Internet of Things: Creating a Connected Customer ExperienceMonetizing the Internet of Things: Creating a Connected Customer Experience
Monetizing the Internet of Things: Creating a Connected Customer Experience
Zuora, Inc.
 
Robust product and ecommerce application programming interface for leading ho...
Robust product and ecommerce application programming interface for leading ho...Robust product and ecommerce application programming interface for leading ho...
Robust product and ecommerce application programming interface for leading ho...
Mindtree Ltd.
 
Big Data in Advertising Industry — Oleksandr Fedirko, Danylo Stepanchuk
Big Data in Advertising Industry — Oleksandr Fedirko, Danylo StepanchukBig Data in Advertising Industry — Oleksandr Fedirko, Danylo Stepanchuk
Big Data in Advertising Industry — Oleksandr Fedirko, Danylo Stepanchuk
GlobalLogic Ukraine
 
Cubitic: Predictive Analytics
Cubitic: Predictive AnalyticsCubitic: Predictive Analytics
Cubitic: Predictive Analytics
huguk
 
Netweb flytxt-big-data-case-study
Netweb flytxt-big-data-case-studyNetweb flytxt-big-data-case-study
Netweb flytxt-big-data-case-study
IntelAPAC
 
Brexit what will happen on June 24th
Brexit what will happen on June 24th Brexit what will happen on June 24th
Brexit what will happen on June 24th
Ian Chapman-Banks
 
Brexit what will happen on June 24th
Brexit what will happen on June 24th Brexit what will happen on June 24th
Brexit what will happen on June 24th
Ian Chapman-Banks
 
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
JK Tech
 
Retail Practice
Retail PracticeRetail Practice
Retail Practice
Q4_sys
 
MPG IIoT Primer - September 2022
MPG IIoT Primer - September 2022MPG IIoT Primer - September 2022
MPG IIoT Primer - September 2022
Madison Park Group
 
Micro Cube Media Kit 2016 ppt.
Micro Cube Media Kit 2016 ppt.Micro Cube Media Kit 2016 ppt.
Micro Cube Media Kit 2016 ppt.
Molly Zhou
 
Webinar- API Strategy - Are we doing it right?
Webinar- API Strategy - Are we doing it right?Webinar- API Strategy - Are we doing it right?
Webinar- API Strategy - Are we doing it right?
Kellton Tech Solutions Ltd
 
Building the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesBuilding the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data Strategies
Kevin Sigliano
 
Develop - App Explosion: Modernizing Your Development Skills
Develop - App Explosion: Modernizing Your Development SkillsDevelop - App Explosion: Modernizing Your Development Skills
Develop - App Explosion: Modernizing Your Development Skills
LaurenWendler
 
NEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptx
NEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptxNEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptx
NEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptx
ahmjkh987
 
CEO Keynote I Love APIs 2015: Chet Kapoor Apigee
CEO Keynote I Love APIs 2015: Chet Kapoor Apigee CEO Keynote I Love APIs 2015: Chet Kapoor Apigee
CEO Keynote I Love APIs 2015: Chet Kapoor Apigee
Apigee | Google Cloud
 
Next-Gen уже здесь
Next-Gen уже здесьNext-Gen уже здесь
Next-Gen уже здесь
CEE-SEC(R)
 
Podcasters and Advertisers Marketplace on Blockchain
Podcasters and Advertisers Marketplace on BlockchainPodcasters and Advertisers Marketplace on Blockchain
Podcasters and Advertisers Marketplace on Blockchain
Cygnet Infotech
 
ParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream - Big Data for Business Users
ParStream - Big Data for Business Users
ParStream Inc.
 
Tech Mpire (TMP) - Product Presentation - July 2017
Tech Mpire (TMP) - Product Presentation - July 2017 Tech Mpire (TMP) - Product Presentation - July 2017
Tech Mpire (TMP) - Product Presentation - July 2017
George Gabriel
 
Monetizing the Internet of Things: Creating a Connected Customer Experience
Monetizing the Internet of Things: Creating a Connected Customer ExperienceMonetizing the Internet of Things: Creating a Connected Customer Experience
Monetizing the Internet of Things: Creating a Connected Customer Experience
Zuora, Inc.
 
Robust product and ecommerce application programming interface for leading ho...
Robust product and ecommerce application programming interface for leading ho...Robust product and ecommerce application programming interface for leading ho...
Robust product and ecommerce application programming interface for leading ho...
Mindtree Ltd.
 
Big Data in Advertising Industry — Oleksandr Fedirko, Danylo Stepanchuk
Big Data in Advertising Industry — Oleksandr Fedirko, Danylo StepanchukBig Data in Advertising Industry — Oleksandr Fedirko, Danylo Stepanchuk
Big Data in Advertising Industry — Oleksandr Fedirko, Danylo Stepanchuk
GlobalLogic Ukraine
 
Cubitic: Predictive Analytics
Cubitic: Predictive AnalyticsCubitic: Predictive Analytics
Cubitic: Predictive Analytics
huguk
 
Netweb flytxt-big-data-case-study
Netweb flytxt-big-data-case-studyNetweb flytxt-big-data-case-study
Netweb flytxt-big-data-case-study
IntelAPAC
 
Brexit what will happen on June 24th
Brexit what will happen on June 24th Brexit what will happen on June 24th
Brexit what will happen on June 24th
Ian Chapman-Banks
 
Brexit what will happen on June 24th
Brexit what will happen on June 24th Brexit what will happen on June 24th
Brexit what will happen on June 24th
Ian Chapman-Banks
 
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
JK Tech
 
Retail Practice
Retail PracticeRetail Practice
Retail Practice
Q4_sys
 
MPG IIoT Primer - September 2022
MPG IIoT Primer - September 2022MPG IIoT Primer - September 2022
MPG IIoT Primer - September 2022
Madison Park Group
 
Micro Cube Media Kit 2016 ppt.
Micro Cube Media Kit 2016 ppt.Micro Cube Media Kit 2016 ppt.
Micro Cube Media Kit 2016 ppt.
Molly Zhou
 
Webinar- API Strategy - Are we doing it right?
Webinar- API Strategy - Are we doing it right?Webinar- API Strategy - Are we doing it right?
Webinar- API Strategy - Are we doing it right?
Kellton Tech Solutions Ltd
 
Building the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesBuilding the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data Strategies
Kevin Sigliano
 
Develop - App Explosion: Modernizing Your Development Skills
Develop - App Explosion: Modernizing Your Development SkillsDevelop - App Explosion: Modernizing Your Development Skills
Develop - App Explosion: Modernizing Your Development Skills
LaurenWendler
 
NEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptx
NEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptxNEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptx
NEXIS BIOMETRICS ECONOMICS FINAL PPT (1).pptx
ahmjkh987
 
CEO Keynote I Love APIs 2015: Chet Kapoor Apigee
CEO Keynote I Love APIs 2015: Chet Kapoor Apigee CEO Keynote I Love APIs 2015: Chet Kapoor Apigee
CEO Keynote I Love APIs 2015: Chet Kapoor Apigee
Apigee | Google Cloud
 
Ad

More from Tech Triveni (20)

UI Dev in Big data world using open source
UI Dev in Big data world using open sourceUI Dev in Big data world using open source
UI Dev in Big data world using open source
Tech Triveni
 
Why should a Java programmer shifts towards Functional Programming Paradigm
Why should a Java programmer shifts towards Functional Programming ParadigmWhy should a Java programmer shifts towards Functional Programming Paradigm
Why should a Java programmer shifts towards Functional Programming Paradigm
Tech Triveni
 
Reactive - Is it really a Magic Pill?
Reactive - Is it really a Magic Pill?Reactive - Is it really a Magic Pill?
Reactive - Is it really a Magic Pill?
Tech Triveni
 
Let’s go reactive with JAVA
Let’s go reactive with JAVALet’s go reactive with JAVA
Let’s go reactive with JAVA
Tech Triveni
 
Tackling Asynchrony with Kotlin Coroutines
Tackling Asynchrony with Kotlin CoroutinesTackling Asynchrony with Kotlin Coroutines
Tackling Asynchrony with Kotlin Coroutines
Tech Triveni
 
Programmatic Ad Tracking: Let the power of Reactive Microservices do talking
Programmatic Ad Tracking: Let the power of Reactive Microservices do talkingProgrammatic Ad Tracking: Let the power of Reactive Microservices do talking
Programmatic Ad Tracking: Let the power of Reactive Microservices do talking
Tech Triveni
 
Let's refine your Scala Code
Let's refine your Scala CodeLet's refine your Scala Code
Let's refine your Scala Code
Tech Triveni
 
Supercharged imperative programming with Haskell and Functional Programming
Supercharged imperative programming with Haskell and Functional ProgrammingSupercharged imperative programming with Haskell and Functional Programming
Supercharged imperative programming with Haskell and Functional Programming
Tech Triveni
 
Observability at scale with Neural Networks: A more proactive approach
Observability at scale with Neural Networks: A more proactive approachObservability at scale with Neural Networks: A more proactive approach
Observability at scale with Neural Networks: A more proactive approach
Tech Triveni
 
Semi-Supervised Insight Generation from Petabyte Scale Text Data
Semi-Supervised Insight Generation from Petabyte Scale Text DataSemi-Supervised Insight Generation from Petabyte Scale Text Data
Semi-Supervised Insight Generation from Petabyte Scale Text Data
Tech Triveni
 
Finding the best solution for Image Processing
Finding the best solution for Image ProcessingFinding the best solution for Image Processing
Finding the best solution for Image Processing
Tech Triveni
 
Proximity Targeting at Scale using Big Data Platforms
Proximity Targeting at Scale using Big Data PlatformsProximity Targeting at Scale using Big Data Platforms
Proximity Targeting at Scale using Big Data Platforms
Tech Triveni
 
Effecting Pure Change - How anything ever gets done in functional programming...
Effecting Pure Change - How anything ever gets done in functional programming...Effecting Pure Change - How anything ever gets done in functional programming...
Effecting Pure Change - How anything ever gets done in functional programming...
Tech Triveni
 
Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)
Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)
Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)
Tech Triveni
 
Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...
Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...
Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...
Tech Triveni
 
Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)
Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)
Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)
Tech Triveni
 
Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...
Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...
Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...
Tech Triveni
 
UX in Big Data Analytics - Paramjit Jolly (Guavus)
UX in Big Data Analytics - Paramjit Jolly (Guavus)UX in Big Data Analytics - Paramjit Jolly (Guavus)
UX in Big Data Analytics - Paramjit Jolly (Guavus)
Tech Triveni
 
Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)
Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)
Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)
Tech Triveni
 
Micro Frontends Architecture - Jitendra kumawat (Guavus)
Micro Frontends Architecture - Jitendra kumawat (Guavus)Micro Frontends Architecture - Jitendra kumawat (Guavus)
Micro Frontends Architecture - Jitendra kumawat (Guavus)
Tech Triveni
 
UI Dev in Big data world using open source
UI Dev in Big data world using open sourceUI Dev in Big data world using open source
UI Dev in Big data world using open source
Tech Triveni
 
Why should a Java programmer shifts towards Functional Programming Paradigm
Why should a Java programmer shifts towards Functional Programming ParadigmWhy should a Java programmer shifts towards Functional Programming Paradigm
Why should a Java programmer shifts towards Functional Programming Paradigm
Tech Triveni
 
Reactive - Is it really a Magic Pill?
Reactive - Is it really a Magic Pill?Reactive - Is it really a Magic Pill?
Reactive - Is it really a Magic Pill?
Tech Triveni
 
Let’s go reactive with JAVA
Let’s go reactive with JAVALet’s go reactive with JAVA
Let’s go reactive with JAVA
Tech Triveni
 
Tackling Asynchrony with Kotlin Coroutines
Tackling Asynchrony with Kotlin CoroutinesTackling Asynchrony with Kotlin Coroutines
Tackling Asynchrony with Kotlin Coroutines
Tech Triveni
 
Programmatic Ad Tracking: Let the power of Reactive Microservices do talking
Programmatic Ad Tracking: Let the power of Reactive Microservices do talkingProgrammatic Ad Tracking: Let the power of Reactive Microservices do talking
Programmatic Ad Tracking: Let the power of Reactive Microservices do talking
Tech Triveni
 
Let's refine your Scala Code
Let's refine your Scala CodeLet's refine your Scala Code
Let's refine your Scala Code
Tech Triveni
 
Supercharged imperative programming with Haskell and Functional Programming
Supercharged imperative programming with Haskell and Functional ProgrammingSupercharged imperative programming with Haskell and Functional Programming
Supercharged imperative programming with Haskell and Functional Programming
Tech Triveni
 
Observability at scale with Neural Networks: A more proactive approach
Observability at scale with Neural Networks: A more proactive approachObservability at scale with Neural Networks: A more proactive approach
Observability at scale with Neural Networks: A more proactive approach
Tech Triveni
 
Semi-Supervised Insight Generation from Petabyte Scale Text Data
Semi-Supervised Insight Generation from Petabyte Scale Text DataSemi-Supervised Insight Generation from Petabyte Scale Text Data
Semi-Supervised Insight Generation from Petabyte Scale Text Data
Tech Triveni
 
Finding the best solution for Image Processing
Finding the best solution for Image ProcessingFinding the best solution for Image Processing
Finding the best solution for Image Processing
Tech Triveni
 
Proximity Targeting at Scale using Big Data Platforms
Proximity Targeting at Scale using Big Data PlatformsProximity Targeting at Scale using Big Data Platforms
Proximity Targeting at Scale using Big Data Platforms
Tech Triveni
 
Effecting Pure Change - How anything ever gets done in functional programming...
Effecting Pure Change - How anything ever gets done in functional programming...Effecting Pure Change - How anything ever gets done in functional programming...
Effecting Pure Change - How anything ever gets done in functional programming...
Tech Triveni
 
Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)
Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)
Becoming a Functional Programmer - Harit Himanshu (Nomis Solutions)
Tech Triveni
 
Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...
Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...
Live coding session on AI / ML using Google Tensorflow (Python) - Tanmoy Deb ...
Tech Triveni
 
Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)
Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)
Distributing the SMACK stack - Kubernetes VS DCOS - Sahil Sawhney (Knoldus Inc.)
Tech Triveni
 
Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...
Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...
Blue Pill / Red Pill : The Matrix of thousands of data streams - Himanshu Gup...
Tech Triveni
 
UX in Big Data Analytics - Paramjit Jolly (Guavus)
UX in Big Data Analytics - Paramjit Jolly (Guavus)UX in Big Data Analytics - Paramjit Jolly (Guavus)
UX in Big Data Analytics - Paramjit Jolly (Guavus)
Tech Triveni
 
Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)
Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)
Simplified Scala Monads And Transformation - Harmeet Singh (Knoldus Inc.)
Tech Triveni
 
Micro Frontends Architecture - Jitendra kumawat (Guavus)
Micro Frontends Architecture - Jitendra kumawat (Guavus)Micro Frontends Architecture - Jitendra kumawat (Guavus)
Micro Frontends Architecture - Jitendra kumawat (Guavus)
Tech Triveni
 
Ad

Recently uploaded (20)

Sustainable_Development_Goals_INDIANWraa
Sustainable_Development_Goals_INDIANWraaSustainable_Development_Goals_INDIANWraa
Sustainable_Development_Goals_INDIANWraa
03ANMOLCHAURASIYA
 
UiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptx
UiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptxUiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptx
UiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptx
anabulhac
 
DNF 2.0 Implementations Challenges in Nepal
DNF 2.0 Implementations Challenges in NepalDNF 2.0 Implementations Challenges in Nepal
DNF 2.0 Implementations Challenges in Nepal
ICT Frame Magazine Pvt. Ltd.
 
In-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptx
In-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptxIn-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptx
In-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptx
aptyai
 
Cybersecurity Tools and Technologies - Microsoft Certificate
Cybersecurity Tools and Technologies - Microsoft CertificateCybersecurity Tools and Technologies - Microsoft Certificate
Cybersecurity Tools and Technologies - Microsoft Certificate
VICTOR MAESTRE RAMIREZ
 
OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...
OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...
OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...
SOFTTECHHUB
 
Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)
Kaya Weers
 
machines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdfmachines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdf
AmirStern2
 
Top 5 Qualities to Look for in Salesforce Partners in 2025
Top 5 Qualities to Look for in Salesforce Partners in 2025Top 5 Qualities to Look for in Salesforce Partners in 2025
Top 5 Qualities to Look for in Salesforce Partners in 2025
Damco Salesforce Services
 
Cybersecurity Threat Vectors and Mitigation
Cybersecurity Threat Vectors and MitigationCybersecurity Threat Vectors and Mitigation
Cybersecurity Threat Vectors and Mitigation
VICTOR MAESTRE RAMIREZ
 
fennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solutionfennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solution
shallal2
 
accessibility Considerations during Design by Rick Blair, Schneider Electric
accessibility Considerations during Design by Rick Blair, Schneider Electricaccessibility Considerations during Design by Rick Blair, Schneider Electric
accessibility Considerations during Design by Rick Blair, Schneider Electric
UXPA Boston
 
論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...
論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...
論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...
Toru Tamaki
 
IT488 Wireless Sensor Networks_Information Technology
IT488 Wireless Sensor Networks_Information TechnologyIT488 Wireless Sensor Networks_Information Technology
IT488 Wireless Sensor Networks_Information Technology
SHEHABALYAMANI
 
Refactoring meta-rauc-community: Cleaner Code, Better Maintenance, More Machines
Refactoring meta-rauc-community: Cleaner Code, Better Maintenance, More MachinesRefactoring meta-rauc-community: Cleaner Code, Better Maintenance, More Machines
Refactoring meta-rauc-community: Cleaner Code, Better Maintenance, More Machines
Leon Anavi
 
Building the Customer Identity Community, Together.pdf
Building the Customer Identity Community, Together.pdfBuilding the Customer Identity Community, Together.pdf
Building the Customer Identity Community, Together.pdf
Cheryl Hung
 
Who's choice? Making decisions with and about Artificial Intelligence, Keele ...
Who's choice? Making decisions with and about Artificial Intelligence, Keele ...Who's choice? Making decisions with and about Artificial Intelligence, Keele ...
Who's choice? Making decisions with and about Artificial Intelligence, Keele ...
Alan Dix
 
React Native for Business Solutions: Building Scalable Apps for Success
React Native for Business Solutions: Building Scalable Apps for SuccessReact Native for Business Solutions: Building Scalable Apps for Success
React Native for Business Solutions: Building Scalable Apps for Success
Amelia Swank
 
Build With AI - In Person Session Slides.pdf
Build With AI - In Person Session Slides.pdfBuild With AI - In Person Session Slides.pdf
Build With AI - In Person Session Slides.pdf
Google Developer Group - Harare
 
Top Hyper-Casual Game Studio Services
Top  Hyper-Casual  Game  Studio ServicesTop  Hyper-Casual  Game  Studio Services
Top Hyper-Casual Game Studio Services
Nova Carter
 
Sustainable_Development_Goals_INDIANWraa
Sustainable_Development_Goals_INDIANWraaSustainable_Development_Goals_INDIANWraa
Sustainable_Development_Goals_INDIANWraa
03ANMOLCHAURASIYA
 
UiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptx
UiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptxUiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptx
UiPath AgentHack - Build the AI agents of tomorrow_Enablement 1.pptx
anabulhac
 
In-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptx
In-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptxIn-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptx
In-App Guidance_ Save Enterprises Millions in Training & IT Costs.pptx
aptyai
 
Cybersecurity Tools and Technologies - Microsoft Certificate
Cybersecurity Tools and Technologies - Microsoft CertificateCybersecurity Tools and Technologies - Microsoft Certificate
Cybersecurity Tools and Technologies - Microsoft Certificate
VICTOR MAESTRE RAMIREZ
 
OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...
OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...
OpenAI Just Announced Codex: A cloud engineering agent that excels in handlin...
SOFTTECHHUB
 
Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)
Kaya Weers
 
machines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdfmachines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdf
AmirStern2
 
Top 5 Qualities to Look for in Salesforce Partners in 2025
Top 5 Qualities to Look for in Salesforce Partners in 2025Top 5 Qualities to Look for in Salesforce Partners in 2025
Top 5 Qualities to Look for in Salesforce Partners in 2025
Damco Salesforce Services
 
Cybersecurity Threat Vectors and Mitigation
Cybersecurity Threat Vectors and MitigationCybersecurity Threat Vectors and Mitigation
Cybersecurity Threat Vectors and Mitigation
VICTOR MAESTRE RAMIREZ
 
fennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solutionfennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solution
shallal2
 
accessibility Considerations during Design by Rick Blair, Schneider Electric
accessibility Considerations during Design by Rick Blair, Schneider Electricaccessibility Considerations during Design by Rick Blair, Schneider Electric
accessibility Considerations during Design by Rick Blair, Schneider Electric
UXPA Boston
 
論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...
論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...
論文紹介:"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning" ...
Toru Tamaki
 
IT488 Wireless Sensor Networks_Information Technology
IT488 Wireless Sensor Networks_Information TechnologyIT488 Wireless Sensor Networks_Information Technology
IT488 Wireless Sensor Networks_Information Technology
SHEHABALYAMANI
 
Refactoring meta-rauc-community: Cleaner Code, Better Maintenance, More Machines
Refactoring meta-rauc-community: Cleaner Code, Better Maintenance, More MachinesRefactoring meta-rauc-community: Cleaner Code, Better Maintenance, More Machines
Refactoring meta-rauc-community: Cleaner Code, Better Maintenance, More Machines
Leon Anavi
 
Building the Customer Identity Community, Together.pdf
Building the Customer Identity Community, Together.pdfBuilding the Customer Identity Community, Together.pdf
Building the Customer Identity Community, Together.pdf
Cheryl Hung
 
Who's choice? Making decisions with and about Artificial Intelligence, Keele ...
Who's choice? Making decisions with and about Artificial Intelligence, Keele ...Who's choice? Making decisions with and about Artificial Intelligence, Keele ...
Who's choice? Making decisions with and about Artificial Intelligence, Keele ...
Alan Dix
 
React Native for Business Solutions: Building Scalable Apps for Success
React Native for Business Solutions: Building Scalable Apps for SuccessReact Native for Business Solutions: Building Scalable Apps for Success
React Native for Business Solutions: Building Scalable Apps for Success
Amelia Swank
 
Top Hyper-Casual Game Studio Services
Top  Hyper-Casual  Game  Studio ServicesTop  Hyper-Casual  Game  Studio Services
Top Hyper-Casual Game Studio Services
Nova Carter
 

Augmentation of bids for programmatic ad auctions @ real time with the power of Reactive Architecture - Sumit srivastava (MIQ)

  • 1. Augmentation of bids for programmatic ad auctions @ real time with the power of Reactive Architecture Sumit Srivastava Engineering Lead - MiQ
  • 2. 2 ❑ Marketing intelligence and Analytics partner to many of the world’s most prominent brands and media agencies American Express, Avis, Lenovo, Unilever, Microsoft, GroupM, Publicis and IPG. ❑ AiQ is our technology that provides modular, API-based analytics services to rapidly build data solutions for successful real-time business outcomes. MiQ - Activating Marketing Intelligence via AiQ Data Scientists & Engineers Data Scientists & Analysts Solution Engineers & Traders
  • 3. 3 Daily Scale @ MiQ 80 Billion Ad Impressions 5000+ Strategies 10+TB Data1000+ Campaigns 750 million users Insights Data mutation & copies Security Scale ● #campaigns ● #no. of people ● varied experience levels Quality Multiple languages & tools
  • 4. 4 The system 35 million IP range records that we store in PostgreSQL, each consisting respective Geo information 35+ Features (parameters) each bid request is evaluated upon 100ms Average lifetime of an ad request including bidding, campaign optimization and creative delivery 7+TB Amount of compressed data generated every day 90% Gateway to the exchange for MiQ campaigns Marketing Intelligence Source to the data powering the core of data science at MiQ
  • 5. 5 ❑ 1.5 million requests per second ❑ Response time below 10ms ❑ IP to Geo resolution The problem statement
  • 7. 7 The journey Version One Version Two Components ● In-house Netty based server ● Off-heap pagination driven custom data structure ● Vert.x ● PostgreSQL Advantages ● Customized to have extremely low memory footprint ● Non-blocking ● Low maintenance ● Highly scalable ● Active community Disadvantages ● High maintenance ● Blocking ● Not scalable ● Complex debug process ● Readability ● No community support ● Slightly higher memory footprint
  • 8. 8 Stats ❑ Requests per server: (10 connections, 10 threads) ● 200k/sec with no lookup data ● 25+k/sec with all features loaded ❑ Average response time: 4ms (95%) ❑ PostgreSQL queries response: <=2ms (99%)
  翻译: