Redis Networking Nerd Down: For Lovers of Packets and Jumbo Frames- John Bullard, Distil Networks

Jun 10, 2016Download as pptx, pdf2 likes1,869 views

Packets per second (PPS) is an often overlooked value within an environment. Most network concerns are around throughput and interface speed, but what happens when this value becomes the bottleneck due to large-scale hosting providers (AWS, Azure, etc.) with rigid standards? This talk covers what a Redis packet looks like and how the out-of-the-box configuration can drastically affect packet per second overhead. From here we’ll deep dive into specific configuration values which help lower PPS numbers, as well as different Redis master/slave relationships that can be utilized to keep PPS below inflexible network thresholds.

For Lovers of Packets and Jumbo Frames
Redis Networking Nerd Down

Intro
John Bullard
VP Engineering
Benji Taylor
DevOps Lead

How the Distil Bot Detection Solution Works
As web traffic passes through Distil, the system
1. Fingerprints each incoming connection and
compares it to our Known Violators Database
1. If it’s a new fingerprint, validates the browser
to determine if it’s a Bot or Not
1. Based on your preferences, automatically tags,
challenges, or blocks the bot

Fortune 500 & Alexa Global 10,000 Customers
Ecommerce
Travel
Publishers
Directories
Traditional Media
Marketplace
Services

Customer Story
○ Large Online Marketplace
High traffic volume
Approaching seasonal peak - 3x traffic
AWS EC2 Classic
○ Soft 100k PPS Limit
○ Customer concern

Customer Story
○ Scaling Up + Out
Master : Slave Topology
○ 9 Node: 1 Master, 8 Slaves
C3.8xlarge Instances
○ 36 vCPU, 60 GiB, 10 Gigabit
Proof of Concept
○ Onboard <5% of traffic

Customer Story
○ Bottleneck - Master PPS
Redis Master : Write + Replicate
○ All nodes write
○ All writes replicate to all nodes
○ Requirements
Master PPS < 100k
No partitioning
EC2 Classic
$0 Cost Increase

Redis Networking Nerd Down: For Lovers of Packets and Jumbo Frames- John Bullard, Distil Networks

Overview
○ Jumbo Caveats
Not supported everywhere (Virtualbox)
“Jumbo” differs among vendors
Every component on path must support it
Switches - drop jumbo frames
Routers - must support ingress and egress

Overview
○ Tuning - Jumbo frames -
AWS Support for jumbo frames:
○ Compute optimized: C3, C4, CC2
○ General purpose: M3, M4, T2 - GPU: CG1, G2
○ Memory optimized: CR1, R3
○ Storage optimized: D2, HI1, HS1, I2
MTU 9001 bytes

Packets
○ TCP Small Packet Problem
Application sending 1 byte packets
TCP packets have a 40 byte header
○ 20 bytes for TCP
○ 20 bytes for IPv4
41 byte packet
○ For 1 byte of useful information

Packets
○ Nagle’s algorithm (RFC 896)
Combine small outgoing messages
Reduce # of packets
Improve TCP/IP efficiency
Trade-off: increased latency
○ Problematic for real-time systems
○ Per-socket: TCP_NODELAY

Packets
# Disable TCP_NODELAY on the slave socket after SYNC?
#
# If you select "yes" Redis will use a smaller number of TCP packets and
# less bandwidth to send data to slaves. But this can add a delay for
# the data to appear on the slave side, up to 40 milliseconds with
# Linux kernels using a default configuration.
#
# If you select "no" the delay for data to appear on the slave side will
# be reduced but more bandwidth will be used for replication.
#
# By default we optimize for low latency, but in very high traffic conditions
# or when the master and slaves are many hops away, turning this to "yes" may
# be a good idea.
repl-disable-tcp-nodelay no

Packets
Master/Slave Chains
Common Architecture for Read Intensive Scenarios
Balance Write Duplication to Read-Slaves
Shift PPS to Read-Slaves
Configuration Change - No Dev
No Added Cost
○ 1 Master
2 Read-Slaves
6 Edgenodes

Packets
○ Approach
Ethernet tuning - Enable Jumbo Packets
TCP/IP tuning - Enable “Naggling”
Topology - Read-Slave fan-out

In this talk we report on our experience with Redis-on-Flash (RoF)—a recently introduced product that uses SSDs as a RAM extension to dramatically increase the effective dataset capacity that can be stored on a single server. This talk provides the first in-depth RoF system performance characterization: we consider different use cases (varying both RAM-to-disk access ratio and object size), and compare SATA-based RoF, NVMe-based RoF, and all-RAM Redis deployments. We show that the superior performance of NVMe drives in terms of both latency and peak bandwidth makes them a particularly good fit for RoF use cases. Specifically, we show that backing RoF with NVMe drives can deliver more than 2 million operations per second with sub-millisecond latency on a single server.

Walmart & IBM Revisit the Linear Road Benchmark- Roger Rea, IBMRedis Labs

The document compares the performance of IBM Streams to other streaming analytics offerings using the Linear Road benchmark, finding that IBM Streams achieved an L-Rating of 200 using 4 Azure nodes, significantly outperforming Apache Apex and Apache Storm. It also describes how Walmart uses streaming analytics for real-time inventory control and logistics monitoring, and how IBM Streams was able to implement the Linear Road benchmark in under 15 days of development time.

Running Analytics at the Speed of Your BusinessRedis Labs

The speed at which you can extract insights from your data is increasingly a competitive edge for your business. Data and analytics have to be at lightning fast speeds to seriously impact your user acquisition. Join this webinar featuring Forrester analyst Noel Yuhanna and Leena Joshi, VP Product Marketing at Redis Labs to learn how you can glean insights faster with new open source data processing frameworks like Spark and Redis. In this webinar you will learn: * Why analytics has to run at the real time speed of business * How this can be achieved with next generation Big Data tools * How data structures can optimize your hybrid transaction-analytics processing scenarios

Date-tiered Compaction Policy for Time-series DataHBaseCon

Clara Xiong (Flurry/Yahoo!) With petabytes of data on thousands of nodes replicated across multiple data centers, growing at an accelerating rate, we have been running a workload at scale with a bottleneck of IO bandwidth. This talk covers a new compaction policy to improve efficiency for time-range scans of various look-back windows by structuring and maintaining a date-tiered store file layout for time-series data with infrequent updates and deletes.

Володимир Цап "Constraint driven infrastructure - scale or tune?"Fwdays

Volodymyr Tsap discusses how to save money on infrastructure through constraint driven design. He provides examples of hardware configurations on AWS, bare metal servers, and PaaS platforms to demonstrate how costs can be optimized. Tsap also outlines ways to reduce software costs through choices in operating system, virtualization, databases, and orchestration. Infrastructure support costs depend on the complexity of the environment, with basic setups costing $500-800 per month while more advanced architectures are $4,000-6,000 per month. The overall message is that money saved through optimization can be invested in people.

Kafka Summit SF 2017 - Infrastructure for Streaming Applications confluent

Criteo uses Kafka for streaming applications including RTB logs, user activity tracking, and analytics. They developed tools for Kafka including a C# driver, watermark injection for determining data completeness, replication between clusters, and monitoring of brokers, consumers and Zookeeper. Criteo's Kafka deployment includes multiple data centers with two clusters each handling different workloads, and is able to process millions of messages per second with low latency.

Day 2 General Session Presentations RedisConfRedis Labs

The document discusses new memory technologies like persistent memory and their implications. It provides latency and bandwidth numbers for different memory types and notes that heterogeneous memory systems using tiers of DRAM and NVM provide opportunities for better performance and cost. Examples are given of key-value stores and databases leveraging NVM to achieve high performance while reducing costs. The talk also discusses how new distributed data structures like CRDTs could be used across servers with shared memory.

Redis Day Keynote Salvatore Sanfillipo Redis LabsRedis Labs

Redis Developers Day 2014 - Redis Labs TalksRedis Labs

Redis for horizontally scaled data processing at jFrog bintrayRedis Labs

Apache HBase, Accelerated: In-Memory Flush and Compaction HBaseCon

RedisConf17- Using Redis at scale @ TwitterRedis Labs

The document discusses Nighthawk, Twitter's distributed caching system which uses Redis. It provides caching services at a massive scale of over 10 million queries per second and 10 terabytes of data across 3000 Redis nodes. The key aspects of Nighthawk's architecture that allow it to scale are its use of a client-oblivious proxy layer and cluster manager that can independently scale and rebalance partitions across Redis nodes. It also employs replication between data centers to provide high availability even in the event of node failures. Some challenges discussed are handling "hot keys" that get an unusually high volume of requests and more efficiently warming up replicas when nodes fail.

HIgh Performance Redis- Tague Griffith, GoProRedis Labs

High Performance Redis looks at a wide range of techniques - from programming to system tuning - to deploy and maintain an extremely high performing Redis cluster. From the operational perspective, the talk lays out multiple techniques for clustering (sharding) Redis systems and examines how the different approaches impact performance time. The talk further examines system settings (Linux network parameters, Redis system) and how they impact performance (both good and bad). Finally, for the developer, we look at how different ways of structuring data actually demonstrate different performance characteristics

Voldemort on Solid State DrivesVinoth Chandar

Voldemort is a distributed key-value storage system used at LinkedIn that was migrated to use solid state drives (SSDs) to improve performance. This led to issues with Java garbage collection causing increased latency. The authors address these issues by modifying the caching strategy to cache only index nodes and evict data objects quickly to reduce fragmentation. They also reduce the cost of garbage collection by controlling promotion rates and the scheduling of garbage collection cycles. Migrating to SSDs requires rethinking caching strategies and garbage collection to fully realize the performance benefits.

RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-MLRedis Labs

Real-time Machine learning with Redis-ML Shay Nativ from Redis Labs presented on using Redis and Redis-ML for real-time machine learning model serving. Redis-ML allows training models with tools like Spark and then deploying them to Redis for low-latency serving. This simplifies the ML lifecycle and improves performance and scalability compared to custom model serving. Shay demonstrated building a movie recommendation system using Spark for training random forests on the MovieLens dataset and deploying the models to Redis-ML for real-time recommendations with 60x faster performance than Spark alone.

Dynomite @ Redis Conference 2016Ioannis Papapanagiotou

Breaking the Sound Barrier with Persistent Memory HBaseCon

Liqi Yi and Shylaja Kokoori (Intel) A fully optimized HBase cluster could easily hit the limit of the underlying storage device’s capability, which is beyond the reach of software optimization alone. To get around this constraint, we need a new design that brings data processing and data storage closer together. In this presentation, we will look at how persistent memory will change the way large datasets are stored. We will review the hardware characteristics of 3D XPoint™, a new persistent memory technology with low latency and high capacity. We will also discuss opportunities for further improvement within the HBase framework using persistent memory.

Accordion HBaseCon 2017Edward Bortnikov

The document describes Accordion, a novel in-memory compaction algorithm for HBase that improves write performance. Accordion applies the log-structured merge tree design used in LSM databases to HBase's memory data structure. This transforms random writes to sequential writes, keeping more data in memory for longer. As a result, Accordion achieves higher write throughput, lower disk I/O, and reduced read latency compared to HBase's previous approach. Accordion has been integrated into HBase 2.0 as the default memory compaction implementation.

25 snowflake剑飞陈

RedisConf18 - Ultra Scaling with Redis EnterpriseRedis Labs

This document discusses various ways to scale Redis as needs increase. It outlines common bottlenecks like max memory or CPU usage on individual shards. Solutions proposed include re-sharding to use multiple cores, scaling nodes up or out by replacing or adding nodes, using Redis on Flash to overcome memory limitations, and employing multi-proxy or cluster APIs to overcome network saturation. The overall message is that Redis Enterprise allows scaling Redis seamlessly and effortlessly through different techniques without requiring code changes.

hbaseconasia2017: Building online HBase cluster of Zhihu based on KubernetesHBaseCon

Zhiyong Bai As a high performance and scalable key value database, Zhihu use HBase to provide online data store system along with Mysql and Redis. Zhihu’s platform team had accumulated some experience in technology of container, and this time, based on Kubernetes, we build flexible platform of online HBase system, create multiple logic isolated HBase clusters on the shared physical cluster with fast rapid，and provide customized service for different business needs. Combined with Consul and DNS server, we implement high available access of HBase using client mainly written with Python. This presentation is mainly shared the architecture of online HBase platform in Zhihu and some practical experience in production environment. hbaseconasia2017 hbasecon hbase

What's new with enterprise Redis - Leena Joshi, Redis LabsRedis Labs

Redis Labs manages over 160k+ HA databases, 10k clustered databases, without data loss in spite of one node failure a day and one data center outage per month. Using Enterprise Redis(RLEC), Redis Labs delivers seamless zero downtime scaling, true high availability with persistence, cross-rack/zone/ datacenter replication and instant automatic failover. Learn how. Join this session for a deep dive into how enterprise Redis makes for no-hassle Redis deployments and the roadmap for new Redis capabilities. Discover new cost savings with Redis on Flash for cost-effective high performance operations and analytics

Роман Новиков "Best Practices for MySQL Performance & Troubleshooting with th...Fwdays

Application Caching: The Hidden MicroserviceScott Mansfield

1. Application caching is used heavily at Netflix to improve performance for many microservices and user experiences like the home page, video playback, and personalization. 2. EVCache is Netflix's custom key-value cache that is distributed, replicated across AWS regions and optimized for their use cases. It handles trillions of operations per day across thousands of servers. 3. Moneta is the next generation of EVCache, using SSD storage in addition to RAM to reduce costs by 70% while maintaining performance. It intelligently manages hot and cold data between storage types.

Kafka Summit SF 2017 - Shopify Flash Sales with Apache Kafkaconfluent

This document discusses how Shopify uses Apache Kafka in their systems architecture. It describes how Kafka provides reliable asynchronous messaging that allows Shopify to collect logs and events and feed them to their data lake. It outlines how Kafka provides operational decoupling and allows them to deploy application or Kafka changes independently. It then discusses two specific use cases: using Kafka as part of a logs/events pipeline and using it to enable active-active Elasticsearch replication across multiple data centers.

Counting image views using redis clusterRedis Labs

Streaming Logs and Processing View Counts using Redis Cluster Seandon Mooy (Imgur) When you browse through Imgur, you notice that each user's post includes the number of views for that particular post. Imgur processes over 3 billion views per month and powers our view count feature using Redis. In this talk, we cover our current architecture for streaming logs and processing view counts using Redis Cluster, as well as some of the alternatives we explored and why we chose Redis.

DataEngConf SF16 - BYOMQ: Why We [re]Built IronMQHakka Labs

The document discusses reasons for reimplementing messaging queue functionality instead of using an existing solution like RabbitMQ or Kafka. It notes that reimplementing provides full understanding and control, allowing for quick fixes and easy addition of features without needing a daemon. However, it also acknowledges that reimplementing takes a long time to reach stability. The document then describes the specific requirements for the reimplemented messaging queue and provides a brief overview of its design and performance.

Troubleshooting Redis- DaeMyung Kang, KakaoRedis Labs

Day 1 General Session RedisConfRedis Labs

More Related Content

What's hot (20)

Redis Day Keynote Salvatore Sanfillipo Redis LabsRedis Labs

Redis Developers Day 2014 - Redis Labs TalksRedis Labs

Redis for horizontally scaled data processing at jFrog bintrayRedis Labs

Apache HBase, Accelerated: In-Memory Flush and Compaction HBaseCon

RedisConf17- Using Redis at scale @ TwitterRedis Labs

HIgh Performance Redis- Tague Griffith, GoProRedis Labs

Voldemort on Solid State DrivesVinoth Chandar

RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-MLRedis Labs

Dynomite @ Redis Conference 2016Ioannis Papapanagiotou

Breaking the Sound Barrier with Persistent Memory HBaseCon

Accordion HBaseCon 2017Edward Bortnikov

25 snowflake剑飞陈

RedisConf18 - Ultra Scaling with Redis EnterpriseRedis Labs

hbaseconasia2017: Building online HBase cluster of Zhihu based on KubernetesHBaseCon

What's new with enterprise Redis - Leena Joshi, Redis LabsRedis Labs

Роман Новиков "Best Practices for MySQL Performance & Troubleshooting with th...Fwdays

Application Caching: The Hidden MicroserviceScott Mansfield

Kafka Summit SF 2017 - Shopify Flash Sales with Apache Kafkaconfluent

Counting image views using redis clusterRedis Labs

DataEngConf SF16 - BYOMQ: Why We [re]Built IronMQHakka Labs

Redis Day Keynote Salvatore Sanfillipo Redis LabsRedis Labs

Redis Developers Day 2014 - Redis Labs TalksRedis Labs

Redis for horizontally scaled data processing at jFrog bintrayRedis Labs

Apache HBase, Accelerated: In-Memory Flush and Compaction HBaseCon

RedisConf17- Using Redis at scale @ TwitterRedis Labs

HIgh Performance Redis- Tague Griffith, GoProRedis Labs

Voldemort on Solid State DrivesVinoth Chandar

RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-MLRedis Labs

Dynomite @ Redis Conference 2016Ioannis Papapanagiotou

Breaking the Sound Barrier with Persistent Memory HBaseCon

Accordion HBaseCon 2017Edward Bortnikov

25 snowflake剑飞陈

RedisConf18 - Ultra Scaling with Redis EnterpriseRedis Labs

hbaseconasia2017: Building online HBase cluster of Zhihu based on KubernetesHBaseCon

What's new with enterprise Redis - Leena Joshi, Redis LabsRedis Labs

Роман Новиков "Best Practices for MySQL Performance & Troubleshooting with th...Fwdays

Application Caching: The Hidden MicroserviceScott Mansfield

Kafka Summit SF 2017 - Shopify Flash Sales with Apache Kafkaconfluent

Counting image views using redis clusterRedis Labs

DataEngConf SF16 - BYOMQ: Why We [re]Built IronMQHakka Labs

Viewers also liked (18)

Troubleshooting Redis- DaeMyung Kang, KakaoRedis Labs

Day 1 General Session RedisConfRedis Labs

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDogRedis Labs

Think you have big data? What about high availability requirements? At DataDog we process billions of data points every day including metrics and events, as we help the world monitor the their applications and infrastructure. Being the world’s monitoring system is a big responsibility, and thanks to Redis we are up to the task. Join us as we discuss how the DataDog team monitors and scales Redis to power our SaaS based monitoring offering. We will discuss our usage and deployment patterns, as well as dive into monitoring best practices for production Redis workloads

Real Time Recommendations Using WebSockets and Redis - Ninad Divadkar, InuitRedis Labs

WebSockets connect the browser to your app server. But what if the processing happens on some other server? In that case you need to connect the worker process to the app process via a messaging system. After experimenting with RabbitMQ, we settled on Redis as a great pub sub and a caching system. This presentation will describe the architecture of the system and how we use spring-websockets and spring-data-Redis to power the system. As a bonus, we will show a great way to find out in real time how many users are currently using your system.

#SydPHP - The Magic of RedisAaron Weatherall

Global Data Stream Network for Internet of ThingsBhavana Srinivas

This document summarizes a presentation about data stream networks and how they help the IoT ecosystem. It defines a data stream network as a secure, global network for two-way communication and real-time data push. It discusses how data stream networks provide services like publish/subscribe messaging, global replication and reliability, presence detection, storage and playback, and access control. Finally, it outlines how data stream networks help solve IoT pain points like presence detection, scalability, bandwidth usage, and security by enabling real-time communication, analytics, message routing and more between mobile/IoT/web applications.

Get more than a cache back! The Microsoft Azure Redis Cache (NDC Oslo)Maarten Balliauw

The document discusses Azure Cache and Redis. It provides an overview of Redis, including its data types, transactions, pub/sub capabilities, scripting, and sharding/partitioning. It then discusses common patterns for using Redis, such as caching, counting likes on Facebook, getting the latest reviews, rate limiting, and autocompletion. The document emphasizes that Redis is very flexible and can be used for more than just caching, acting as a general datastore. It concludes by recommending a Redis reference book for further learning.

Build a Geospatial App with Redis 3.2- Andrew Bass, Sean Yesmunt, Sergio Prad...Redis Labs

Use Redis in Odd and Unusual WaysItamar Haber

Getting Started with RedisFaisal Akber

Redis is an advanced key-value store or a data structure server. This presentation will cover the following topics: * An overview of Redis * Data Structures * Basics of Setup and Installation * Basics of Administration * Programming with Redis * Considerations of Running Redis in a Virtual Machine * Redis Resources There will be a number of demonstrations to help explain some of the concepts being presented.

Redis Developers Day 2015 - Secondary Indexes and State of LuaItamar Haber

Streaming and Visualizing Data with D3.jsPubNub

RespClient - Minimal Redis Client for PowerShellYoshifumi Kawai

UV logic using redis bitmap주용 오

flowspec @ APF 2013Tom Paseka

This document discusses Flowspec, a mechanism for filtering traffic flows using BGP. It can be used to easily rate limit or discard traffic based on attributes like source/destination addresses and ports. The document provides sample configuration examples and notes some limitations like lack of SNMP support for counters. It also shows graphs of attacks detected and mitigated using Flowspec rules.

Using Redis as Distributed Cache for ASP.NET apps - Peter Kellner, 73rd Stre...Redis Labs

I will build from scratch in this session a Microsoft ASP.NET website that caches WebAPI REST calls with both MSOpenTech’s Redis implementation for running while developing in Visual Studio as well as running on a Windows server running IIS. I will show you how to build a safe reusable caching library in c# that can be used in any .net project. I will also demonstrate how to use the Redis cache services that are available on Microsoft’s Azure cloud platform. Further, I’ll demonstrate a real world web site that uses Azure Redis cache and show statistics on how Redis improves performance consistently and reliably.

RedisConf 2016 talk - The Redis API: Simple, Composable, PowerfulDynomiteDB

Scalable Streaming Data Pipelines with RedisAvram Lyon

Slides for talk presented at LA Redis meetup, April 16, 2016 at Scopely. This is a draft of a session to be presented at Redis Conference 2016. Description: Scopely's portfolio of social and mid-core games generates billions of events each day, covering everything from in-game actions to advertising to game engine performance. As this portfolio grew in the past two years, Scopely moved all event analysis from third-party hosted solutions to a new event analytics pipeline on top of Redis and Kinesis, dramatically reducing operating costs and enabling new real-time analysis and more efficient warehousing. Our solution receives events over HTTP and SQS and provides real-time aggregation using a custom Redis-backed application, as well as prompt loads into HDFS for batch analyses. Recently, we migrated our realtime layer from a pure Redis datastore to a hybrid datastore with recent data in Redis and older data in DynamoDB, retaining performance while further reducing costs. In this session we will describe our experience building, tuning and monitoring this pipeline, and the role of Redis in supporting handling of Kinesis worker failover, deployment, and idempotence, in addition to its more visible role in data aggregation. This session is intended be helpful for those building streaming data systems and looking for solutions for aggregation and idempotence.

Troubleshooting Redis- DaeMyung Kang, KakaoRedis Labs

Day 1 General Session RedisConfRedis Labs

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDogRedis Labs

Real Time Recommendations Using WebSockets and Redis - Ninad Divadkar, InuitRedis Labs

#SydPHP - The Magic of RedisAaron Weatherall

Global Data Stream Network for Internet of ThingsBhavana Srinivas

Get more than a cache back! The Microsoft Azure Redis Cache (NDC Oslo)Maarten Balliauw

Build a Geospatial App with Redis 3.2- Andrew Bass, Sean Yesmunt, Sergio Prad...Redis Labs

Use Redis in Odd and Unusual WaysItamar Haber

Getting Started with RedisFaisal Akber

Redis Developers Day 2015 - Secondary Indexes and State of LuaItamar Haber

Streaming and Visualizing Data with D3.jsPubNub

RespClient - Minimal Redis Client for PowerShellYoshifumi Kawai

UV logic using redis bitmap주용 오

flowspec @ APF 2013Tom Paseka

Using Redis as Distributed Cache for ASP.NET apps - Peter Kellner, 73rd Stre...Redis Labs

RedisConf 2016 talk - The Redis API: Simple, Composable, PowerfulDynomiteDB

Scalable Streaming Data Pipelines with RedisAvram Lyon

Similar to Redis Networking Nerd Down: For Lovers of Packets and Jumbo Frames- John Bullard, Distil Networks (20)

Challenges and experiences with IPTV from a network point of viewbrouer

LinuxCon2009: 10Gbit/s Bi-Directional Routing on standard hardware running Linuxbrouer

This talk my 2009 updates on the progress of doing 10Gbit/s routing on standard hardware running Linux. The results are good, BUT to achieve these results, a lot of tuning is required of hardware queues, MSI interrupts and SMP affinity, together with some (now) submitted patches. I\'ll explain the concept of network hardware queues and why interrupt and SMP tuning is essential. I\'ll present results from different hardware both 10GbE netcards and CPUs (current CPUs under test is AMD phenom and Core i7). Many future challenges still exists, especially in the area of more easy tuning. A high knowledge level about the Linux kernel is required to follow all the details.

Computer network (7)NYversity

This document summarizes topics that may be covered on a CS144 review session exam, including testing simultaneous open connections in TCP, logistics of the exam, sample exam questions and explanations, an overview of protocols like TCP, IP, and DNS, and concepts related to routing, physical layer transmission, and more. Sample exam questions are provided to illustrate the level of detail and reasoning expected in answers.

High perf-networkingmtimjones

This document discusses various ways to enhance networking performance in high-bandwidth applications. It covers application-level optimizations like adjusting Nagle's algorithm and TCP buffer sizes. It also discusses transport-level options like TCP stack selection and modifications, use of specialized networking hardware, and alternative protocols like SCTP. The goal is to minimize data copies, protocol overhead, and optimize resource usage to increase throughput and reduce latency.

100 M pps on PC.Redge Technologies

This document discusses achieving very high speeds of 100 million packets per second (100Mpps) on commodity PC hardware using kernel bypassing techniques. It describes the company redCDN and their development of a DDoS mitigation solution called redGuardian. Key challenges discussed include the limitations of operating system network stacks at high speeds, hardware capabilities, and how data plane frameworks like DPDK can be used to bypass the OS and achieve wire-speed performance by accessing network interface cards directly from userspace.

The WebRTC Data ChannelSvetlin Mladenov

New idc architectureMason Mei

This document discusses cloud data center network architectures and how to scale them using Arista switches. It describes the limitations of legacy data center designs and introduces the cloud networking model. The cloud networking model with Arista switches provides benefits like lower latency, no oversubscription between racks, and the ability to scale to hundreds of racks. The document then discusses how to scale the network using layer 2, layer 3, and VXLAN designs from thousands to over a million nodes. It provides examples of scaling the number of leaf and spine switches to achieve greater node counts in a non-blocking two-tier design.

1-Isp-Network-Design-1Justin Knight

The document discusses ISP network design. It covers topics such as point of presence (PoP) topologies and modules, backbone design including routing protocols and link types, and placement of ISP services like DNS. For DNS, it recommends having a primary server in a secure location, secondary servers for redundancy in diverse locations, and caching servers in each PoP for fast lookups. The document provides examples of effective DNS deployment with secondary servers around the world.

A new perspective on Network Visibility - RISK 2015Network Performance Channel GmbH

The document discusses network visibility solutions from Net Optics and Ixia. It summarizes that Net Optics was acquired by Ixia but will remain a brand name. It then discusses challenges of network growth outpacing monitoring tools, security threats increasing, and the need for improved network performance and visibility. The document promotes Ixia and Net Optics solutions like network taps, packet brokers, and virtual monitoring tools that provide intelligent traffic distribution and filtering to gain complete network visibility without blind spots.

Collaborate nfs kyle_finalKyle Hailey

The document discusses tuning NFS for Oracle databases. It begins by introducing the author Kyle Hailey and his background with Oracle. It then discusses various storage architectures like DAS, NAS, and SAN and how NFS can be an attractive option but requires configuration for optimal performance. The document focuses on specific NFS tuning aspects like network topology, TCP configuration including MTU sizes, and NFS mount options to reduce latency and improve throughput for database workloads over NFS.

VOIP QOSThomas Mangin

This document discusses quality of service (QoS) requirements for voice over IP (VoIP) and how QoS can be implemented in packet switched networks to address issues like jitter, latency, bandwidth congestion, and packet loss that can negatively impact call quality. It explains that QoS aims to guarantee a certain level of performance for applications like VoIP through techniques like traffic classification, marking, and queuing. The document also provides recommendations for applying QoS on the network edge, core, and internet exchange points to help improve end-to-end call quality.

How To Use Kafka and Druid to Tame Your Router Data (Rachel Pedreschi, Imply ...confluent

Do you know who is knocking on your network’s door? Have new regulations left you scratching your head on how to handle what is happening in your network? Network flow data helps answer many questions across a multitude of use cases including network security, performance, capacity planning, routing, operational troubleshooting and more. Today’s modern day streaming data pipelines need to include tools that can scale to meet the demands of these service providers while continuing to provide responsive answers to difficult questions. In addition to stream processing, data needs to be stored in a redundant, operationally focused database to provide fast, reliable answers to critical questions. Together, Kafka and Druid work together to create such a pipeline. In this talk Eric Graham and Rachel Pedreschi will discuss these pipelines and cover the following topics: -Network flow use cases and why this data is important. -Reference architectures from production systems at a major international Bank. -Why Kafka and Druid and other OSS tools for Network Flows. -A demo of one such system.

How To Use Kafka and Druid to Tame Your Router Data (Rachel Pedreschi and Eri...confluent

Do you know who is knocking on your network’s door? Have new regulations left you scratching your head on how to a handle what is happening in your network? Network flow data helps answer many questions across a multitude of use cases including network security, performance, capacity planning, routing, operational troubleshooting and more. Today’s modern day streaming data pipelines need to include tools that can scale to meet the demands of these service providers while continuing to provide responsive answers to difficult questions. In addition to stream processing, data needs to be stored in a redundant, operationally focused database to provide fast, reliable answers to critical questions. Together, Kafka and Druid work together to create such a pipeline. In this talk Eric Graham and Rachel Pedreschi will discuss these pipelines and cover the following topics: Network flow use cases and why this data is important. Reference architectures from production systems at a major international Bank. Why Kafka and Druid and other OSS tools for Network flows. A demo of one such system.

Network.pptxSAMANTHACARDOSO13

The network layer routes packets between devices on a network through multiple hops. It must address scalability issues around representing addresses and routing packets as networks grow large. Routers connect multiple local area networks, which may use different link layer technologies. IP addresses use a hierarchical structure to improve routing scalability. Classless Inter-Domain Routing (CIDR) allows arbitrary allocation of addresses and subnets to minimize routing tables.

Resilient Network Design Concepts EducatSamGrandprix

The document discusses network design concepts for building a resilient network. It emphasizes the importance of considering redundancy at multiple levels, from the physical infrastructure to network protocols. Well-designed networks are modular, have clearly defined functional layers, and incorporate redundancy through techniques like load balancing and diverse circuit paths. Hierarchical network designs with logical areas can also improve convergence times during failures.

Performance challenges in software networkingStephen Hemminger

Stephen Hemminger discusses performance challenges in software networking. He addresses myths about throughput limits and compares hardware and software approaches. Optimization requires analyzing bottlenecks like CPU cache usage and avoiding locks. While benchmarks use ideal conditions, real systems have bursty traffic, many rules, and limited resources. The performance of software networking depends on algorithms, CPU efficiency, and handling cache behavior.

7.) convergence (w automation)Jeff Green

Next Generation Ethernet Next Generation Ethernet is a platform that should deliver all of previous function requirements under on hood. I have grouped the Generations in this way because Cisco has different purpose-built product lines for each of 4 waves of technology. Counter to that Extreme offers a platform solution for a customer to build his network on. Extreme does not require different switches to address different convergence requirements, this would be cost prohibitive for most customers and complicated. Simply put to disrupt the Cisco market, Extreme must deliver more with less. The IEEE is pushing Ethernet to unimaginable speeds, with the 40/100Gigabit Ethernet standard expected to be ratified in 2010 and Terabit Ethernet on the drawing board for 2015. Here's a timeline showing key milestones in the growth of Ethernet Sstandard's-compliant products are expected to ship in the second half of next year, not long after the expected June 2010 ratification of the 802.3ba standard. Complexity - Complex systems are a special type of chaotic system. They display a very interesting type of emergent behavior called, logically enough, complex adaptive behavior. But we are getting ahead of ourselves. There’s a need to back up a bit and describe a fundamental behavior that occurs at the granular level and leads to complex adaptive behavior. It is self -organization. Complex Adaptive Behavior is the name given to this forming-falling apart-reforming-falling apart-… behavior. Specifically it is defined as many agents working in parallel to accomplish a goal. It is conflict ridden, very fluid, and very positive. The hallmark of emergent, complex adaptive behavior is it brings about a change from the starting point that is not just different in degree but in kind. In biology a good example of this is the emergence of consciousness. Another example is the Manhattan Project and the development of the atomic bomb. Below is a checklist that helps facilitate a qualitative assessment of the level of complexity. It is in everyday language to facilitate use by a broad range of stakeholders and team members. In other words, it stays away from jargon, which can be the kiss of death when requesting information from people. The Checklist Not sure how the project will get done; Many stakeholders, teams and sub-teams; Too Many vendors; New vendors; New client; Team members are geographically dispersed; End-users are geographically dispersed; Many organizations; Many cultures (professional, organizational, sociological); Many languages (professional, organizational, sociological); High risk; Lack of quality best characterized by lack of acceptance criteria; Lack of clear requirements and too Many tasks; Arbitrary budget or end date; Inadequate resources; Leading-edge technology; New, unproven application of existing technology; High degree of interconnectedness (professional, technological, political, sociological).

PLNOG 13: Alexis Dacquay: Handling high-bandwidth-consumption applications in...PROIDEA

Alexis Dacquay – is CCIE with over 10 years experience in the networking industry. He has in the past been designing, deploying, and supporting some large corporate LAN/WAN networks. He has in the last 4 years specialised in high performance datacenter networking to satisfy the needs of cloud providers, web2.0, big data, HPC, HFT, and any other enterprise for which high performing network is critical to their business. Originally from Bretagne, privately a huge fan of polish cuisine. Topic of Presentation: Handling high-bandwidth-consumption applications in a modern DC design Language: English Abstract: Modern Data Centre requires proper handling of high-bandwidth consuming applications, like BigData or IP Storage. To achieve this, next generation Ethernet speeds of 25, 50 and 100Gbps are being pursued. We are to show _why_ these new Ethernet speeds are vital from technology standpoint and _how_ to cope with the those sparkling new requirements by networking hardware enablements. We are to share ethernet switches’ design considerations, with the biggest emphasis put on the importance of big buffers and how they accommodate this bursty traffic. Throughout the presentation we will additionally elaborate on the evolution of variety of modern applications, and how we can handle those with the properly designed hardware, software, and Data Centre itself.

Internet Of Things: Hands on: YOW! nightAndy Gelme

Razin Kabir (063452556)mashiur

This document discusses bandwidth calculation for Voice over Internet Protocol (VoIP). It explains that bandwidth required depends on factors like the codec, sample period, IP headers, and transmission medium. It provides examples of bandwidth calculations for codecs like G.711 and G.729a using IP, UDP, RTP headers and Ethernet transmission. Bandwidth can be reduced up to 50% using silence suppression. The document also lists common VoIP services and includes a diagram of a VoIP network architecture with a multiprotocol switch.

Challenges and experiences with IPTV from a network point of viewbrouer

LinuxCon2009: 10Gbit/s Bi-Directional Routing on standard hardware running Linuxbrouer

Computer network (7)NYversity

High perf-networkingmtimjones

100 M pps on PC.Redge Technologies

The WebRTC Data ChannelSvetlin Mladenov

New idc architectureMason Mei

1-Isp-Network-Design-1Justin Knight

A new perspective on Network Visibility - RISK 2015Network Performance Channel GmbH

Collaborate nfs kyle_finalKyle Hailey

VOIP QOSThomas Mangin

How To Use Kafka and Druid to Tame Your Router Data (Rachel Pedreschi, Imply ...confluent

How To Use Kafka and Druid to Tame Your Router Data (Rachel Pedreschi and Eri...confluent

Network.pptxSAMANTHACARDOSO13

Resilient Network Design Concepts EducatSamGrandprix

Performance challenges in software networkingStephen Hemminger

7.) convergence (w automation)Jeff Green

PLNOG 13: Alexis Dacquay: Handling high-bandwidth-consumption applications in...PROIDEA

Internet Of Things: Hands on: YOW! nightAndy Gelme

Razin Kabir (063452556)mashiur

More from Redis Labs (20)

Redis Day Bangalore 2020 - Session state caching with redisRedis Labs

This document discusses using Redis caching to improve performance for the DBS Paylah mobile wallet application. Paylah aims to significantly increase its user base which will increase load on its backend systems. Caching application data and session state in Redis can reduce latency, improve responsiveness for users, and reduce costs by lowering load on legacy backend databases and mainframes. The document outlines some key Paylah use cases where caching transaction histories and account details in Redis would accelerate retrieval and improve the mobile experience by avoiding the need to access slower backend systems on each request.

Protecting Your API with Redis by Jane Paek - Redis Day Seattle 2020Redis Labs

The document discusses rate limiting and metering using Redis. It begins by introducing rate limiting and metering and why Redis is well-suited for these tasks. It then covers different Redis data structures that can be used, such as lists, hashes, sorted sets and strings. Common Redis commands for counting, setting keys and checking time to live are also presented. Different rate limiting design patterns and anti-patterns are described, including fixed window, sliding window and token bucket approaches. Finally, resources for further information are provided.

The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...Redis Labs

The document summarizes a presentation about using Protocol Buffers and Redis together. It discusses how Protocol Buffers provide strict data types, versioning, and serialization/deserialization benefits. It then outlines Redis key patterns using namespaces, versions, data categories and identifiers. Examples are provided to show how Protocol Buffers messages can be stored in Redis using these key patterns, including storing connections data in sets, sorted sets and individual messages. Benefits discussed include structure, readability, testing and abstraction.

SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020Redis Labs

The document discusses common use cases for combining SQL, Redis, and Kubernetes including caching, session management, rate limiting, and data ingestion. It outlines how Kubernetes can be used for scaling microservices while Redis is used for data service scaling. The presentation proposes combining Redis, SQL Server, and Kubernetes with a proxy service, and describes using Redis for caching, session storage, and rate limiting of SQL data. It also discusses running Redis and front-end apps on Kubernetes and deploying SQL as a Kubernetes service through a proxy.

Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...Redis Labs

This document discusses using Rust and Redis to build cloud native platforms. It first provides context about devops and the need to do more with less. It then discusses how platforms are becoming more distributed and Kubernetes upends distribution paradigms. The document dives into how Rust addresses issues like concurrency and systems programming. It also discusses how Redis can be used for caching, queues, streams and more. Finally, it mentions that Rust and Redis will be demonstrated.

Redis for Data Science and Engineering by Dmitry Polyakovsky of OracleRedis Labs

This document contains a presentation about using Redis for data science and engineering. It introduces the presenter and provides an agenda that covers using Redis for data science and data engineering. The presentation notes that Redis can be used as both a data store and job queue, has flexible data structures and is fast, though it uses RAM and cannot query by value. It also lists Python Pandas and includes a demo and links for further information.

Practical Use Cases for ACLs in Redis 6 by Jamie Scott - Redis Day Seattle 2020Redis Labs

Jamie Scott from RedisLabs presented on practical use cases for access control lists (ACLs) in Redis 6. The presentation covered new security features in Redis 6 including encryption in transit, key space and command restrictions, and multiple access control list users. It demonstrated how ACLs allow users to define access based on key labels and restrictions. ACLs can facilitate discretionary and mandatory access controls. The presentation showed examples of using ACLs to restrict user access by key labels and commands to enhance operational security.

Moving Beyond Cache by Yiftach Shoolman Redis Labs - Redis Day Seattle 2020Redis Labs

This document summarizes a presentation about Redis version 6 and beyond. Some key points include: - Redis version 6 includes new features like ACL for security, client-side caching, diskless replication, and multi-threaded I/O. - Redis is positioned as both a cache and a database due to its speed, data structures, and ability to handle complex data models through modules. - Redis Enterprise provides additional capabilities like durability, high availability, geo-distribution, security and multi-tenancy. - Modern data models in Redis modules include Streams, RediSearch, RedisGraph, RedisTimeSeries, RedisAI, RedisJSON and RedisBloom. - RedisInsight is

Leveraging Redis for System Monitoring by Adam McCormick of SBG - Redis Day S...Redis Labs

The document discusses how Sinclair Broadcast Group leverages Redis for system monitoring of its content delivery network. It operates 193 news stations with 10,000 active pages daily and millions in archive. New stories are posted every 15 seconds and must be visible across its 1,000+ targets within 1 minute. Redis is used to track performance across the multi-level CDN and ensure service level agreements are met with real-time resolution and alerting. It provides a black box view of the audience experience and can scale monitoring to all relevant pages within 30 seconds. Redis acts as a distributed data store to parallelize the monitoring task across the large scale of the network.

JSON in Redis - When to use RedisJSON by Jay Won of Coupang - Redis Day Seatt...Redis Labs

The document summarizes a presentation about when to use the RedisJSON data type. It discusses how Coupang uses Redis extensively for their ad platform. It then compares the performance and memory usage of storing JSON data as strings, hashes, or using the RedisJSON data type. Benchmark results show RedisJSON can provide better performance for retrieving and updating JSON fields compared to strings and hashes, though it uses more memory. The document recommends using RedisJSON for smaller JSON payloads after benchmarking and memory monitoring.

Highly Available Persistent Session Management Service by Mohamed Elmergawi o...Redis Labs

The document discusses the challenges of building a highly available persistent session management service. It describes Zulily's legacy architecture which lacked high availability and required manual intervention. A new architecture is proposed using Redis for persistent storage, Dynomite for real-time replication across data centers, and a connection pooling proxy to improve efficiency and distribute load. The architecture provides high availability through replication, reduces overhead through connection pooling, and handles failures through consistent hashing and health checks. It was tested through simulations and showed a failure rate of only 0.42% during outages.

Anatomy of a Redis Command by Madelyn Olson of Amazon Web Services - Redis Da...Redis Labs

The document describes the process that a Redis command follows from the client side to the server side. On the client side, the command is sent over the network to the Redis server. On the server side, the command is read from the kernel buffers, validated, executed by calling the relevant command handler, and the response is written back to the client over the network. The core functions involved on the server side are ReadQueryFromClient(), ProcessInputBuffer(), ProcessCommand(), Call(), and handleClientsWithPendingWrites(). Redis 6.0 introduced I/O threads to handle reads and writes in parallel for improved performance while still maintaining Redis' single-threaded processing model.

Building a Multi-dimensional Analytics Engine with RedisGraph by Matthew Goos...Redis Labs

This document discusses MDmetrix, a healthcare data intelligence company that uses RedisGraph to provide flexible analysis of hospital data. RedisGraph is a graph database that represents data as nodes and relationships and uses an adjacency matrix and linear algebra to query the graph. MDmetrix models its healthcare data as a property graph in RedisGraph to allow for complex queries across different data dimensions like patients, facilities, procedures and drugs. RedisGraph allows MDmetrix to query the data more easily than traditional OLAP cubes or relational databases due to the semi-structured and flexible nature of the graph model.

RediSearch 1.6 by Pieter Cailliau - Redis Day Bangalore 2020Redis Labs

RediSearch 1.6 includes a new low-level API that allows other Redis modules to embed RediSearch indexing capabilities. It also introduces index aliasing and several performance improvements such as forked thread garbage collection. Based on benchmarks, RediSearch 1.6 shows 48-73% better performance than version 1.4, particularly during high update rates where it maintains more stable read latencies.

RedisGraph 2.0 by Pieter Cailliau - Redis Day Bangalore 2020Redis Labs

RedisGraph 2.0 provides significant improvements including: - Full text search support through embedded RediSearch 1.6 enabling graph-aided search. - Support for returning full graph responses to enable better visualization. - Broad support for Cypher including triadic closure and new graph-aided search capabilities. - Performance improvements of up to 3.7x faster operations per second and 3.9x faster query times compared to RedisGraph v1.2. - Support for benchmarking including the LDBC benchmark.

RedisTimeSeries 1.2 by Pieter Cailliau - Redis Day Bangalore 2020Redis Labs

RedisTimeSeries is a time-series database that provides compression to reduce memory usage by up to 98% and improve performance. The RedisTimeSeries 1.2 release includes compression algorithms based on a Facebook paper that provide stable ingestion times independent of the number of data points. It also includes a reviewed API with performance improvements and clearer functionality. Performance testing showed ingestion throughput improved by 2-3% and query performance increased from 15-70% with the new release compared to the previous version.

RedisAI 0.9 by Sherin Thomas of Tensorwerk - Redis Day Bangalore 2020Redis Labs

This document summarizes RedisAI 0.9 and its capabilities for model deployment and benchmarking. It introduces RedisAI's new tensor data type and ability to deploy models to CPU and GPU. It then discusses AIBench, a tool developed to benchmark AI serving solutions like RedisAI, TensorFlow Serving, and REST APIs. The benchmarks show RedisAI providing 5.5x and 2.5x more inferences than REST APIs and TensorFlow Serving respectively, due to its data locality. The document concludes by mentioning RedisAI's integration with MLFlow for model deployment with a single command.

Rate-Limiting 30 Million requests by Vijay Lakshminarayanan and Girish Koundi...Redis Labs

The document discusses how Freshworks uses Redis Labs to rate limit 30 million API requests per day through their API gateway called Fluffy. Fluffy stores rate limit policies and maintains counters to track requests. Redis Labs allows Fluffy to easily scale to handle the high volume of requests by providing a fast, in-memory data store for managing rate limiting counters. The system was able to successfully rate limit 30 million requests per day with Redis Labs.

Three Pillars of Observability by Rajalakshmi Raji Srinivasan of Site24x7 Zoh...Redis Labs

Solving Complex Scaling Problems by Prashant Kumar and Abhishek Jain of Myntr...Redis Labs

Redis was used by Myntra to solve several complex scaling problems. It was used to build a scalable user segment service to support high read throughput of up to 5 million requests per minute with low latency. Redis allowed the service to scale beyond a single instance and included features like automatic backups and memory management. Redis also helped build a scalable mobile verification platform to reliably handle 100,000 requests per minute and scale to support higher future volumes. It was used as both a transient store and persistent backend. Finally, Redis locks helped build a scalable A/B testing platform by allowing experiments to be created and updated in an orderly concurrent fashion.