Case Study with Answers.com on Scaling with Memcached and MySQL

Editor's Notes

• #43: These three are interrelated Content is Dynamic and PersonalTake a step back…Many more people and not just in the USATraffic (cisco petabyte data): measuring in petabytes per monthApplications: Dynamic and personalized
• #44: A lot of this population is coming into US-based social networking, gaming, media sites… distance means latency issue.Proliferation of broadband drove users to the net.USA #33 in broadband (>2Mbps); #16 in average speed. Miniwatts data shows the shift to Europe and Asia in particular.World internet usage is only NOW @ 1.6b now (24% according to 50x15 site)NOW MOBILE is adding rapidly to this population explosion.Akamai state of the internet report for q1 2009 gives very insightful information of current data trends.
• #45: Consumer is driving the traffic growth (3x of business)>40% CAGR growth (4x in 4 years)
• #47: How do sites make the same software stack go faster
• #48: Why we are here again:Scalable stack framework for LAMP and Java had/have to emerge in order to accelerate stack and provide distribution services
• #49: Why we are here again:Scalable stack framework for LAMP and Java had/have to emerge in order to accelerate stack and provide distribution services
• #50: 100ms latency introduced by traversing internet to origin site Typically +0.1 secs means 2-4% DROP in revenue
• #51: 100ms latency introduced by traversing internet to origin site Typically +0.1 secs means 2-4% DROP in revenue
• #53: Maslow's Hierarchy Of Needs
• #56: Increases revenue via being able to economically scale and support more members, services and transactionsScalable stack framework delivered as a network service addressable by all stack componentsOnramp information into Memory ASAPMemcached has emerged as de facto protocol to load information into memory BUT a lot more is neededMemcached ++ Focused on caching functions Advance network-based distributed services Non relational functions
• #57: Web 2.0 driving user & traffic growth Key Apps: Entertainment, Communication, Social Networking Key Drivers: Mobile, Broadband, International, ConsumerMobile applications – 3G+ is 22% by 2010 (Mobile goes hi speed)Consumer Internet Traffic 2006–2012 This category encompasses any IP traffic that crosses the Internet and is not confined to a single service provider’s network. Peer-to-peer (P2P) traffic, still the largest share of Internet traffic today, will decrease as a percentage of overall Internet traffic. Internet video streaming and downloads are beginning to take a larger share of bandwidth, and will grow to nearly 50 percent of all consumer Internet traffic in 2012.
• #60: We talked about “Universal Distro” and EC2 beforeGear6 Web Cache Software requirements:Certified on HP, Dell, Rackable…Requires dedicated serverRedundant GE ports or 10 GE ports64-bit (x86 64) server with 32GB or more of RAMIDE/SATA HD with 80GB+Option: 2.5” SATA drive bays for Flash SSDs - Intel X25-E or SamsungGear6 Web Cache delivers:High availability and consistent scalable high performance50k-200k Memcached ops per sec32-300+GB Memcached space per rack unitFault toleranceComplete cache control and visibility of resourcesCost effective mechanism of scaling database and application tiers
• #61: We talked about “Universal Distro” and EC2 beforeGear6 Web Cache Software requirements:Certified on HP, Dell, Rackable…Requires dedicated serverRedundant GE ports or 10 GE ports64-bit (x86 64) server with 32GB or more of RAMIDE/SATA HD with 80GB+Option: 2.5” SATA drive bays for Flash SSDs - Intel X25-E or SamsungGear6 Web Cache delivers:High availability and consistent scalable high performance50k-200k Memcached ops per sec32-300+GB Memcached space per rack unitFault toleranceComplete cache control and visibility of resourcesCost effective mechanism of scaling database and application tiers