<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xml:base="http://thestandard.com" xmlns:dc="http://purl.org/dc/elements/1.1/">
<channel>
 <title>The Industry Standard - Facebook and LinkedIn talk scaling - Comments</title>
 <link>http://thestandard.com/news/2008/07/01/facebook-and-linkedin-talk-about-scaling</link>
 <description>Comments for &quot;Facebook and LinkedIn talk scaling&quot;</description>
 <language>en</language>
<item>
 <title>I should certainly hope so!</title>
 <link>http://thestandard.com/news/2008/07/01/facebook-and-linkedin-talk-about-scaling#comment-2368</link>
 <description>&lt;!--paging_filter--&gt;&lt;p&gt;I should certainly hope so! Working here is the second job I&#039;ve gotten through working my LinkedIn contacts. ;)&lt;/p&gt;
</description>
 <pubDate>Sun, 06 Jul 2008 14:19:09 -0700</pubDate>
 <dc:creator>Cyndy Aleo-Carreira509894</dc:creator>
 <guid isPermaLink="false">comment 2368 at http://thestandard.com</guid>
</item>
<item>
 <title>About.com just released</title>
 <link>http://thestandard.com/news/2008/07/01/facebook-and-linkedin-talk-about-scaling#comment-2291</link>
 <description>&lt;p&gt;&lt;!--paging_filter--&gt;About.com just released their Top 10 List of the best employment websites:&lt;/p&gt;
&lt;p&gt;&lt;a href=&quot;http://jobsearch.about.com/od/joblistings/tp/jobbanks.htm&quot; title=&quot;http://jobsearch.about.com/od/joblistings/tp/jobbanks.htm&quot; rel=&quot;nofollow&quot;&gt;http://jobsearch.about.com/od/joblistings/tp/jobbanks.htm&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;Linkedin made the list!&lt;/p&gt;
</description>
 <pubDate>Wed, 02 Jul 2008 07:23:46 -0700</pubDate>
 <dc:creator>Trisha</dc:creator>
 <guid isPermaLink="false">comment 2291 at http://thestandard.com</guid>
</item>
<item>
 <title>Facebook and LinkedIn talk scaling</title>
 <link>http://thestandard.com/news/2008/07/01/facebook-and-linkedin-talk-about-scaling</link>
 <description>&lt;!--paging_filter--&gt;&lt;p&gt;&lt;img src=&quot;/sites/thestandard.com/files/u4993/facebook_logo.gif&quot; ilo-full-src=&quot;http://thestandard.com/sites/thestandard.com/files/u4993/facebook_logo.gif&quot; alt=&quot;Facebook logo image&quot; align=&quot;left&quot; border=&quot;0&quot; hspace=&quot;10&quot; vspace=&quot;10&quot; width=&quot;150&quot; /&gt;When one Web 2.0 application after another has trouble with scaling, (to the point where outages become as famous, if not more so, than the service) companies should be looking to emulate those examples that have achieved scale. Both Facebook and LinkedIn revealed a peek behind the curtains in two separate interviews that describe their scaling successes.
&lt;p&gt;Facebook VP of Technical Operations Jonathan Heiliger &lt;a href=&quot;http://news.cnet.com/8301-13953_3-9980569-80.html?part=rss&amp;amp;subj=news&amp;amp;tag=2547-1_3-0-20&quot;&gt;spoke with CNET&#039;s Dan Farber&lt;/a&gt; about Facebook&#039;s architecture, which currently supports 80 million users, increasing at a rate of about 250,000 users per day. Using PHP as the primary development language, Facebook has a completely different challenge than Google does with scaling. Every query has to deal with the social relationships between users and data points with 50,000 transactions per second across the Facebook application as well as the platform, which hosts over 100,000 developers.&lt;/p&gt;
&lt;p&gt;&lt;img src=&quot;/sites/thestandard.com/files/u4993/linkedin_logo.gif&quot; ilo-full-src=&quot;http://thestandard.com/sites/thestandard.com/files/u4993/linkedin_logo.gif&quot; alt=&quot;LinkedIn logo image&quot; align=&quot;left&quot; border=&quot;0&quot; height=&quot;36&quot; hspace=&quot;10&quot; vspace=&quot;10&quot; width=&quot;129&quot; /&gt;LinkedIn is far more forthcoming with their architecture, having presented a virtual how-to in two sessions employees gave at JavaOne 2008. &lt;a href=&quot;http://hurvitz.org/blog/2008/06/linkedin-architecture&quot;&gt;Oren Hurvitz summarizes the slide shows&lt;/a&gt; (available at SlideShare), which give an intimate look at the company&#039;s numbers. LinkedIn has 22 million members, with over 4 million unique visitors each month. The site gets 40 million page views and 2 million searches per day.&lt;/p&gt;
&lt;p&gt;What&#039;s even more interesting about LinkedIn&#039;s information is the timeline the company presented of the evolution of its architecture. When the site first launched (and for the first two years), engineers used a single Web app with one core database and a social graph cached in a cloud architecture. Five years later, that original web app is nothing more than the front end that users see when they log in; the actual nuts and bolts of LinkedIn are performed by broken-out services, each of which has its own database.&lt;/p&gt;
&lt;p&gt;LinkedIn even went so far as to reveal the current hardware supporting &amp;quot;The Cloud,&amp;quot; which caches the entire network graph: 22 million nodes with 40 instances. A rebuild of The Cloud from disk takes a full eight hours, and LinkedIn&#039;s estimates include support for up to 1.1 billion users before they would run out of RAM with their current set-up (Sun servers with up to 2 TB of RAM).&lt;/p&gt;
&lt;p&gt;The LinkedIn presentations ended with tips any company should keep in mind when planning an application that needs to scale:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;i&gt;Can’t use just one database. Use many databases, partitioned horizontally and vertically.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Because of partitioning, forget about referential integrity or cross-domain JOINs.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Forget about 100% data integrity.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;At large scale, cost is a problem: hardware, databases, licenses, storage, power.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Once you’re large, spammers and data-scrapers come a-knocking.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Cache!&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Use asynchronous flows.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Reporting and analytics are challenging; consider them up-front when designing the system.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Expect the system to fail.&lt;/i&gt;&lt;/li&gt;
&lt;li&gt;&lt;i&gt;Don’t underestimate your growth trajectory.&lt;/i&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Some companies may want to take out a pencil and notebook and write those down.&lt;/p&gt;
&lt;p&gt;&lt;b&gt;More news, commentary, and predictions from &lt;i&gt;The Industry Standard&lt;/i&gt;:&lt;/b&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Prediction: &lt;b&gt;&lt;a href=&quot;/predictions/suggestions/linkedin-files-ipo-2009&quot;&gt;LinkedIn files for IPO in 2009&lt;/a&gt;&lt;/b&gt;&lt;/li&gt;
&lt;li&gt;Analysis: &lt;b&gt;&lt;a href=&quot;/news/2008/06/23/how-safely-use-facebook-and-linkedin-work&quot;&gt;How to safely use Facebook and LinkedIn at work&lt;/a&gt;&lt;/b&gt;&lt;/li&gt;
&lt;li&gt;News: &lt;b&gt;&lt;a href=&quot;/news/2008/06/30/facebook-confirms-andreessen-its-newest-board-member&quot;&gt;Facebook confirms Andreessen as its newest board member&lt;/a&gt;&lt;/b&gt;&lt;/li&gt;
&lt;/ul&gt;
</description>
 <comments>http://thestandard.com/news/2008/07/01/facebook-and-linkedin-talk-about-scaling#comments</comments>
 <category domain="http://thestandard.com/taxonomy/term/833">co:Facebook</category>
 <category domain="http://thestandard.com/taxonomy/term/2228">co:LinkedIn</category>
 <category domain="http://thestandard.com/taxonomy/term/5996">scaling</category>
 <category domain="http://thestandard.com/taxonomy/term/5667">Software &amp;amp; Web</category>
 <category domain="http://thestandard.com/taxonomy/term/2514">The Industry Standard</category>
 <pubDate>Tue, 01 Jul 2008 20:12:31 -0700</pubDate>
 <dc:creator>Cyndy Aleo-Carreira</dc:creator>
 <guid isPermaLink="false">108968 at http://thestandard.com</guid>
</item>
</channel>
</rss>
