public marks

PUBLIC MARKS with tags performance & clevermarks

March 2008

The Spread Toolkit

by mbertier (via)
Spread is an open source toolkit that provides a high performance messaging service that is resilient to faults across local and wide area networks. Spread functions as a unified message bus for distributed applications, and provides highly tuned application-level multicast, group communication, and point to point support. Spread services range from reliable messaging to fully ordered messages with delivery guarantees. Spread can be used in many distributed applications that require high reliability, high performance, and robust communication among various subsets of members. The toolkit is designed to encapsulate the challenging aspects of asynchronous networks and enable the construction of reliable and scalable distributed applications. Spread consists of a library that user applications are linked with, a binary daemon which runs on each computer that is part of the processor group, and various utility and demonstration programs.

Design details of’s high performance MySQL search engine |

by mbertier (via)
As I mentioned before, search was one of most interesting problems I worked on at Audiogalaxy. It was one of the core functions of the site, and somewhere between 50 to 70 million searches were performed every day. At peak times, the search engine needed to handle 1500-2000 searches every second against a MySQL database with about 200 million rows. It was frequently hard to design for more than 10 or 100x our current traffic (and our growth was so dramatic that there wasn’t really ever time to spend more than a few weeks on the problem), so it wasn’t until the 4th major iteration on the cluster design that I really considered the scale problems to be solved.

February 2008


by mbertier & 3 others (via)
This is pen, a load balancer for "simple" tcp based protocols such as http or smtp. It allows several servers to appear as one to the outside and automatically detects servers that are down and distributes clients among the available servers. This gives high availability and scalable performance.

Apsis Gmbh

by mbertier & 1 other (via)
The Pound program is a reverse proxy, load balancer and HTTPS front-end for Web server(s). Pound was developed to enable distributing the load among several Web-servers and to allow for a convenient SSL wrapper for those Web servers that do not offer it natively. Pound is distributed under the GPL - no warranty, it's free to use, copy and give away.

Hypertable: An Open Source, High Performance, Scalable Database

by mbertier & 2 others (via)
Hypertable is an open source project based on published best practices and our own experience in solving large-scale data-intensive tasks. Our goal is to bring the benefits of new levels of both performance and scale to many data-driven businesses who are currently limited by previous-generation platforms. Our goal is nothing less than that Hypertable become the world’s most massively parallel high performance database platform.

Main - Nginx Wiki

by mbertier & 3 others (via)
Nginx ("engine x") is a high-performance HTTP server and reverse proxy, as well as an IMAP/POP3 proxy server. Nginx was written by Igor Sysoev for, Russia's second-most visited website, where it has been running in production for over two and a half years. Igor has released the source code under a BSD-like license. Although still in beta, Nginx is known for its stability, rich feature set, simple configuration, and low resource consumption.

January 2008

StaticGenerator for Django

by mbertier & 1 other
StaticGenerator is a Python class for Django that makes it easy to create static files for lightning fast performance. It accepts strings (URL), Models (class or instance), Managers, and QuerySets in a simple syntax:

December 2007

eZ publish à très hautes performances

by mbertier & 1 other
Avec des techniques des publication statique, eZ publish peut être déployé sur des sites à très hautes performances

Database parallelism choices greatly impact scalability - The Database Column

by nhoizey & 1 other
Large databases require the use of parallel computing resources to get good performance. There are several fundamentally different parallel architectures in use today

repcached - add data replication feature to memcached

by mbertier (via)
"repached" is patch set which adds data replication feature to memcached 1.2.x.

November 2007

Stu On PHP - » Six Classic Ways To Group Your Web Servers

by mbertier (via)
There are six classic ways to group the servers that your web-based applications run on. Many small PHP shops start small, and scale up their applications when necessary. However popular your customer’s website, all web-based applications written in PHP can be refactored to run on any of the classic architecture solutions, allowing you to grow with the demand that you’re experiencing.

High Scalability | Building bigger, faster, more reliable websites.

by nhoizey & 5 others
High Scalability was started to help build successful scalable websites. It tries to bring together all the lore, art, science, practice, and experience of building scalable websites into one place so you can learn how to build your system with confidence

October 2007

Nati Shalom's Blog: Why most large-scale Web sites are not written in Java

by nhoizey
The application stack of these Web applications is very different from the stack that mission-critical applications in the financial world are built with.

August 2007

Julien Lecomte’s Blog » Gzip Your Minified JavaScript Files

by nhoizey & 1 other
For optimal performance, gzip your JavaScript code, and stay away from “advanced” JavaScript compression schemes that look attractive on paper, but end up degrading the performance of your site.

symfony and the .htaccess file at Spindrop

by Xavier Lacot & 1 other
One performance boost that can be garnered from a symfony app (or any app for that matter) is disabling .htaccess.

Target Practice - A Workshop in Tuning MySQL Queries - Jay Pipes

by mbertier (via)
I gave a tutorial at OSCON last week on tuning MySQL queries, the EXPLAIN statement, the optimizer, and benchmarking. I've gone ahead and put the tutorial materials online now:

MySQL Performance Blog » Landscape of Transactional Storage Engines for MySQL

by mbertier (via)
talks about current state behavior and performance properties of Innodb, Falcon, PBXT and SolidDB Storage Engines

Performance tips for web applications « The Storyteller

by mbertier & 3 others (via)
I was trying to improve performance for a web application recently keeping them in mind. Let me describe how to do some of them technically.

June 2007

Mike Davidson: How To Keep Widgets From Slowing Down Sites: WEDJE

by mbertier (via)
WEDJE is similar to the innerHTML method above except it creates what is effectively a cross-platform, cross-browser defer, enabling your script to load and execute asynchronously across all environments.

SlickSpeed Selectors Test

by nhoizey & 7 others
Des tests de performances automatisés des principales librairie Javascript : Prototype, jQuery, MooTools, ext, cssQuery, dojo query

May 2007