memcache – Page 2 – KutuKupret colorful website

Nginx Memcached Module, Caching Webiste Image Using Memcached

During my exploration of optimzing website using memcached, i’ve found this tutorial. It’s quite interesting using key value application (memcached) for serving website’s static content, Such as image, jss or js file. As we know, Reading/writing Hardrive is slower than accessing memory. although compared with SSD or 7,200 RPM hard drives. Even when an application is loaded, any files that are opened for use in that application are loaded into memory. As well as how web servers work.

First time following the tutorial, it isn’t work. image files not loaded into memcached, no warn, now error. after slightly modifying the script, image files can be stored into the memcached perfectly.

Here’s the php script after modification, i saved it as mem.php

1<?php
2 
3function rscandir($base='', &$data=array()) {
4        $array = array_diff(scandir($base), array('.', '..'));
5 
6        foreach($array as $value) {
7                if (is_dir($base."/".$value)) {
8                        $data = rscandir($base."/".$value,$data);
9 
10                }
11                elseif (is_file($base."/".$value)) {
12                $rest = substr($value, -4);
13                        if ((!strcmp($rest,'.jpg')) || (!strcmp($rest,'.png')) || (!strcmp($rest,'.gif'))) {
14                                $data[] = $base."/".$value;
15                        }
16                }
17 
18        }
19return $data;
20 
21}
22 
23$mylist=rscandir("/path/to/public_html");
24 
25$srch = array('/path/to/public_html');
26$newval = array('');
27 
28$memcache_obj = memcache_connect("127.0.0.1", 11211);
29 
30while (list($key, $val) = each($mylist)) {
31        $url=str_replace($srch,$newval,$val);
32        echo "$key => $val -> ".filesize($val)."\n";
33        $value = file_get_contents($val);
34        memcache_add($memcache_obj, $url, $value, false, 0);
35}
36 
37?>

admin May 13, 2011memcache, nginx3

memcache nginx php

Nginx Memcached module And PHP

I’ve seen lots of tutorials on internet explaining how set nginx to use memcached module. But, i’ve rarely seen them explaining, even the easiest one on how to populate memcached with data generated by php. When i’m getting in touch with memcached for the first time, i thought default configuration like this will be working out of the box. without touching php script.

1server {
2 
3    listen 80;
4    server_name  example.com www.example.com;
5 
6    # ...
7 
8    location ~ \.php$ {
9        set $memcached_key "kutu:$request_uri";
10        memcached_pass 127.0.0.1:11211;
11 
12        default_type       text/html;
13        error_page 404 405 502 = @cache_miss;
14    }
15 
16    location @cache_miss {
17        fastcgi_pass 127.0.0.1:9000;
18        fastcgi_index index.php;
19        fastcgi_param SCRIPT_FILENAME /path/to/yoursite/htdocs$fastcgi_script_name;
20        include /etc/nginx/fastcgi_params;
21    }
22 
23    # ...
24}

Well, i was totally confused :D. so, to prevent other people misinterpret on how nginx memcached module works, i wrote simple examples, and simple explainations on how to configure nginx and populate data generated from php.

admin May 12, 2011memcache, nginx, php9

memcache

Memcached In A shell Using nc And echo

Some example accessing memcached from a shell using nc and echo

Storage Commands

1set
2add
3get
4gets
5replace
6append
7prepend
8cas
9delete
10command [key] [flags] [exptime] [bytes] [noreply]\r\n[value]\r

Parameters :

1[key]           : the key of the data stored
2[flags]         : 32-bit unsigned integer that the server store with the data (provided by the user), and return along the data when the item is retrieved
3[exptime]       : expiration time in seconds, 0 mean no delay, if exptime is superior to 30 day, Memcached will use it as a UNIX timestamps for expiration
4[bytes]         : number of bytes in the data block
5[cas unique]        : unique 64-bit value of an existing entry (retrieved with gets command) to use with cas command
6[noreply]       : optional parameter that inform the server to not send the reply

admin May 5, 2011echo, linux, memcache, nc, netcat, shell1

memcache mysql php

Memcached And PHP, Caching Mysql Query Result

I’ve been messing around with memcached and php-pecl-memcache to cache sql query result. Many web sites & applications such as Facebook, LiveJournal, Flickr, Slashdot, WikiPedia/MediaWiki, SourceForge, Digg and Twitter use memcached to enhance their performance.

Memcached (Memory Cache Daemon) was developed by the team at LiveJournal to improve performance of their social blogging site by minimizing the impact of the bottleneck caused by reading data directly from the database. Memcached is a server that caches Name Value Pairs in memory. The “Name”, or key, is limited to 250 characters, and the “Value” is limited to 1MB in size. Values can consist of data, HTML Fragments, or binary objects; almost any type of data that can be serialized and fits in memcached can be stored.

here is simple example/demonstration how to cache regular sql query

First of all, we need memcached daemon run on system

`1`	`$` `ps` `ax \|` `grep` `memcached`

`2`	`8955 ? Ssl 0:00 memcached -d -p 11211 -u memcached -m 256 -c 1024 -P /var/run/memcached/memcached.pid -l 127.0.0.1`

Setup simple mysql database/tables as shown bellow:

`1`	`mysql-shell> CREATE DATABASE memcache;`

Copy/Paste this tables schema to your mysql shell/console

1CREATE TABLE memc
2(
3 personID int NOT NULL AUTO_INCREMENT,
4 PRIMARY KEY(personID),
5 FirstName varchar(15),
6 LastName varchar(15),
7 Age int
8);
9hit enter/return key

Insert some data

`1`	`mysql-shell> INSERT INTO memc (FirstName, LastName, Age) VALUES('Memory', 'Cache', '100');`

admin May 4, 2011memcache, mysql, php7