public marks

PUBLIC MARKS from mbertier with tag performance

March 2008

The Spread Toolkit

Spread is an open source toolkit that provides a high performance messaging service that is resilient to faults across local and wide area networks. Spread functions as a unified message bus for distributed applications, and provides highly tuned application-level multicast, group communication, and point to point support. Spread services range from reliable messaging to fully ordered messages with delivery guarantees. Spread can be used in many distributed applications that require high reliability, high performance, and robust communication among various subsets of members. The toolkit is designed to encapsulate the challenging aspects of asynchronous networks and enable the construction of reliable and scalable distributed applications. Spread consists of a library that user applications are linked with, a binary daemon which runs on each computer that is part of the processor group, and various utility and demonstration programs.

Design details of’s high performance MySQL search engine |

As I mentioned before, search was one of most interesting problems I worked on at Audiogalaxy. It was one of the core functions of the site, and somewhere between 50 to 70 million searches were performed every day. At peak times, the search engine needed to handle 1500-2000 searches every second against a MySQL database with about 200 million rows. It was frequently hard to design for more than 10 or 100x our current traffic (and our growth was so dramatic that there wasn’t really ever time to spend more than a few weeks on the problem), so it wasn’t until the 4th major iteration on the cluster design that I really considered the scale problems to be solved.

February 2008


by 3 others (via)
This is pen, a load balancer for "simple" tcp based protocols such as http or smtp. It allows several servers to appear as one to the outside and automatically detects servers that are down and distributes clients among the available servers. This gives high availability and scalable performance.

Varnish - Trac

by 4 others (via)
Varnish is a state-of-the-art, high-performance HTTP accelerator. Varnish is targeted primarily at the FreeBSD 6/7 and Linux 2.6 platforms, and takes full advantage of the virtual memory system and advanced I/O features offered by these operating systems

Apsis Gmbh

by 1 other (via)
The Pound program is a reverse proxy, load balancer and HTTPS front-end for Web server(s). Pound was developed to enable distributing the load among several Web-servers and to allow for a convenient SSL wrapper for those Web servers that do not offer it natively. Pound is distributed under the GPL - no warranty, it's free to use, copy and give away.

Hypertable: An Open Source, High Performance, Scalable Database

by 2 others (via)
Hypertable is an open source project based on published best practices and our own experience in solving large-scale data-intensive tasks. Our goal is to bring the benefits of new levels of both performance and scale to many data-driven businesses who are currently limited by previous-generation platforms. Our goal is nothing less than that Hypertable become the world’s most massively parallel high performance database platform.

Main - Nginx Wiki

by 3 others (via)
Nginx ("engine x") is a high-performance HTTP server and reverse proxy, as well as an IMAP/POP3 proxy server. Nginx was written by Igor Sysoev for, Russia's second-most visited website, where it has been running in production for over two and a half years. Igor has released the source code under a BSD-like license. Although still in beta, Nginx is known for its stability, rich feature set, simple configuration, and low resource consumption.

January 2008

StaticGenerator for Django

by 1 other
StaticGenerator is a Python class for Django that makes it easy to create static files for lightning fast performance. It accepts strings (URL), Models (class or instance), Managers, and QuerySets in a simple syntax:

December 2007

eZ publish à très hautes performances

by 1 other
Avec des techniques des publication statique, eZ publish peut être déployé sur des sites à très hautes performances

repcached - add data replication feature to memcached

"repached" is patch set which adds data replication feature to memcached 1.2.x.

November 2007

Stu On PHP - » Six Classic Ways To Group Your Web Servers

There are six classic ways to group the servers that your web-based applications run on. Many small PHP shops start small, and scale up their applications when necessary. However popular your customer’s website, all web-based applications written in PHP can be refactored to run on any of the classic architecture solutions, allowing you to grow with the demand that you’re experiencing.

August 2007

memcached Cacti Template

by 1 other (via)
This template provides a host template and associated graphs for graphing the output of the memcached stats command on individual memcached installations.

Target Practice - A Workshop in Tuning MySQL Queries - Jay Pipes

I gave a tutorial at OSCON last week on tuning MySQL queries, the EXPLAIN statement, the optimizer, and benchmarking. I've gone ahead and put the tutorial materials online now:

MySQL Performance Blog » Landscape of Transactional Storage Engines for MySQL

talks about current state behavior and performance properties of Innodb, Falcon, PBXT and SolidDB Storage Engines

Performance tips for web applications « The Storyteller

by 3 others (via)
I was trying to improve performance for a web application recently keeping them in mind. Let me describe how to do some of them technically.

July 2007

Exceptional Performance

by 3 others
Yahoo!'s Exceptional Performance team evangelizes best practices for improving web performance. They conduct research, build tools, write articles and blogs, and speak at conferences. Their best practices center around the rules for high performance web sites.

Mark's IT Blog: MySQL 5 High Availability with DRBD 8 and Heartbeat 2

In this article, we're going to go through the entire process of installing, configuring and testing DRBD, Heartbeat and MySQL running in a 2 node cluster environment. This will be a bare bones configuration, best practices and security will take a back seat while we learn how all the different pieces work together.

June 2007

Mike Davidson: How To Keep Widgets From Slowing Down Sites: WEDJE

WEDJE is similar to the innerHTML method above except it creates what is effectively a cross-platform, cross-browser defer, enabling your script to load and execute asynchronously across all environments.

May 2007

minify - Google Code

by 11 others (via)
Minify attempts to fix this problem by combining multiple CSS or JavaScript files into one download. By default, it also removes comments and unnecessary whitespace to decrease the amount of data that must be sent to the browser. Most importantly, it does all of this on the fly and requires only a few simple changes to your existing web pages.

January 2007

Zend_Memory Proposal - Alexander Veremyev - Zend Framework Proposals - Zend Framework Wiki

Zend_Memory is a component that offers API for managing data in limited memory mode.

MySQL Performance Blog » Performance impact of complex queries

What is often underestimated is impact of MySQL Performance by complex queries on large data sets(ie some large aggregate queries) and batch jobs. It is not rare to see queries which were taking milliseconds to stall for few seconds, especially in certain OS configurations, and on low profile servers (ie having only one disk drive) even if you just have one such query running concurrently.

mbertier's TAGS related to tag performance

ajax +   apache +   benchmarking +   bestpractices +   cache +   clev +   clevermarks +   database +   design +   dev +   django +   drupal +   ezpublish +   framework +   groupe:clever age +   howto +   http +   javascript +   lamp +   messaging +   monitoring +   mysql +   optimisation +   php +   python +   replication +   slides +   symfony +   sys +   tools +   tuning +   web +   webdev +