PDA

View Full Version : Any of you fellow big boards using datastore caching in 3.6.x?


telc
19 Oct 2006, 14:05
Any of you guys using APC/memcached/FileSystem datastore caching in 3.6.x?

I am wondering what query hits I will save on from enabling it.

Will I only save on a single select from the datastore table when a page is loaded?

I can't find much documentation on it another then how to enable it.

Have any of you guys noticed an improvement or any problems after enabling it?

ubuntu-geek
19 Oct 2006, 15:31
I am using http://trac.lighttpd.net/xcache/ along with the datastore and if I disable it I really can tell a difference in site performance. I found xcache to be alot faster then APC.

Blackhat
22 Oct 2006, 08:16
where can I find the settings for this?

ubuntu-geek
22 Oct 2006, 17:25
This works pretty well for me.. No complaints.



[xcache-common]
;; install as zend extension (recommended), normally "$extension_dir/xcache.so"
;zend_extension = /usr/local/lib/php/extensions/non-debug-non-zts-xxx/xcache.so
;; For windows users, replace xcache.so with php_xcache.dll
;zend_extension_ts = c:/php/extensions/php_xcache.dll
;; or install as extension, make sure your extension_dir setting is correct
extension = xcache.so
;; or win32:
; extension = php_xcache.dll

; required for >=php5.1 if you turn XCache on
auto_globals_jit = Off

[xcache.admin]
xcache.admin.user = "user"
; xcache.admin.pass = md5($your_password)
xcache.admin.pass = "somemd5password"

[xcache]
; ini only settings, all the values here is default unless explained
; to disable: xcache.size=0
; to enable : xcache.size=any size > 0 and your system mmap allows
xcache.size = 96M
; set to cpu count (cat /proc/cpuinfo |grep -c processor)
xcache.count = 2
; just a hash hints, you can always store count(items) > slots
xcache.slots = 16K
; ttl of the cache item, 0=forever
xcache.ttl = 0
; interval of gc scanning expired items, 0=no scan, other values is in seconds
xcache.gc_interval = 0

; same as aboves but for variable cache
xcache.var_size = 96M
xcache.var_count = 2
xcache.var_slots = 16K
; default ttl
xcache.var_ttl = 0
xcache.var_maxttl = 0
xcache.var_gc_interval = 300

xcache.test = Off
; N/A for /dev/zero
xcache.readonly_protection = Off
; for *nix, xcache.mmap_path is a file path, not directory.
; Use something like "/tmp/xcache" if you want to turn on ReadonlyProtection
; 2 group of php won't share the same /tmp/xcache
; for win32, xcache.mmap_path=anonymous map name, not file path
xcache.mmap_path = "/dev/zero"


; leave it blank(disabled) or "/tmp/phpcore/"
; make sure it's writable by php (without checking open_basedir)
xcache.coredump_directory = ""

; per request settings
xcache.cacher = On
xcache.optimizer = On

[xcache.coverager]
; ini only settings
; make sure it's readable (care open_basedir) coverage viewer script
xcache.coveragedump_directory = "/tmp/pcov/"

; per request settings, will be auto disabled if xcache.coveragedump_directory is not set
xcache.coveragedumper = Off

telc
23 Oct 2006, 01:18
I am refering to the vbulletin datastore caching. Instead of having vbulletin use the datastore table, you can have vbulletin cache the values in memcached, apc, or filesystem.

hilfe-forum
23 Oct 2006, 17:24
i Use APC in comb. with Master Slave DB and Template Chace.
www.hilfe-forum.eu

No Probs.


ACP make Forum 20% faster
Master/Slave 30%
Template Chace 20%

Erwin
02 Nov 2006, 04:32
I use memcache. Support is built-in.

telc
03 Nov 2006, 14:26
I would like to know exactly what query hits we would save on by using the memcache. Would it just save from a single select statement to the datastore table? vBulletin does not give much information on this feature.

ubuntu-geek
11 Nov 2006, 02:51
I use memcache. Support is built-in.
Erwin how much ram do you start memcache with? Just curious.

mute
11 Nov 2006, 12:28
If you are using just the default vb stuff, you don't need much memory at all. The default 64mb is overkill even, you could get away with 32mb.

Milez
16 Nov 2006, 13:46
I am sorry I have looked and cannot find this datastore caching setting in Vb? Where is it?

I am running eAccelerator. Do people find APC is better for PHP caching?

About memcached...After reading the memcached wiki (http://en.wikipedia.org/wiki/Memcached) they mention that queries have to be reformed to use memcached. Is that so with Vbulletin? Or can you just install it and it works?

orban
17 Nov 2006, 07:58
I was using FileSystem (?) with APC, but switched to memcached yesterday, bit hard to tell the difference yet.$

vBulletin only supports memcached for parts of the datastore and nothing else. My next project after template cache + sphinx search will be memcached for vbulletin (caching everything that is possible, from styles to languages, forums, threads, posts, users).

ubuntu-geek
17 Nov 2006, 15:23
I was using FileSystem (?) with APC, but switched to memcached yesterday, bit hard to tell the difference yet.$

vBulletin only supports memcached for parts of the datastore and nothing else. My next project after template cache + sphinx search will be memcached for vbulletin (caching everything that is possible, from styles to languages, forums, threads, posts, users).
Nice..

mute
18 Nov 2006, 03:20
We cache some non standard stuff in memcache. It started as just tossing more stuff into the datastore, but has since evolved to include templates, styles, and hopefully soon post and sig caches, archived posts, etc.

orban
18 Nov 2006, 09:54
Can you post a few code bits? :)

vB is so terrible. The language is in the same query as the user information, so I fear without code modification I won't get anywhere. :(

mute
18 Nov 2006, 18:17
I'll talk to my coworker about it. For the first time since we updated to 3.6 we've got our templates back in memcache, so the code is a bit beta.

It'll probably be a bit before it is really sharable :)

It is also pretty messy in that it is not really able to be done w/ a plugin. So far we have an external memcache class and there will be file modifications that need to be done :/

orban
18 Nov 2006, 19:20
For templates I use my own template cache addon, that's awesome (20 times faster on big templates like postbit)

But mainly interested in how to cache languages and stuff..mm...f

vbullfan
15 Dec 2006, 19:54
We have APC on webserver and Memcached on db. Both do wonders for our load.

orban
15 Dec 2006, 21:46
How did you implement memcached? Just for the datastore?

Zia
18 Dec 2006, 05:31
hello..
we got eAcclerator - with 32 MB of ram
we got 256 Mb of ram.

now planning to install memcache ..
any of u tell me... eAcclerator & Memcache can stay together ?
How much ram needed for Memcache ?

w aslo got ioncube installed.

Thnx.

orban
18 Dec 2006, 09:51
Very little if you only use it for the datastore.

Memcached store objects in memory, eAccelerator stores opcode in memory.

Zia
18 Dec 2006, 15:42
Thnx Orban..
then eAcclerator + Memcache(http://pecl.php.net/package/memcache)
and Ioncube can stay together ?

orban
18 Dec 2006, 16:56
Yes that's correct. They come in at different parts of a request.

Zia
03 Feb 2007, 06:43
umm umm maybe a dumbs qus...

using it..any way to see what/how its caching things ?

how to determine memcache is working properly?

like eAcclerator shows a summury like bellow

http://img201.imageshack.us/img201/6485/eamd9.jpg


memcahce ? how to check its performace?

and how much memory it will use (64mb)..have to fix it durinng installation?

and what r those stands for:

memcache.allow_failover
memcache.max_failover_attempts
memcache.chunk_size
memcache.default_port


Table of Contents

Memcache::add — Add an item to the server
Memcache::addServer — Add a memcached server to connection pool
Memcache::close — Close memcached server connection
Memcache::connect — Open memcached server connection
memcache_debug — Turn debug output on/off
Memcache::decrement — Decrement item's value
Memcache::delete — Delete item from the server
Memcache::flush — Flush all existing items at the server
Memcache::get — Retrieve item from the server
Memcache::getExtendedStats — Get statistics from all servers in pool
Memcache::getServerStatus — Returns server status
Memcache::getStats — Get statistics of the server
Memcache::getVersion — Return version of the server
Memcache::increment — Increment item's value
Memcache:.pconnect — Open memcached server persistent connection
Memcache::replace — Replace value of the existing item
Memcache::set — Store data at the server
Memcache::setCompressThreshold — Enable automatic compression of large values
Memcache::setServerParams — Changes server parameters and status at runtime

this table of contents functions are built it? no other xtra modules are needed?

wtrk
13 Feb 2007, 19:45
we use: eaccellerator + memcached + lighttpd

Zia
22 Feb 2007, 18:43
any one?
any idea datastore cache with Xcache?

Mickie D
23 Feb 2007, 20:18
i use the datastore with memcached

i run the memcache server on the same server as my mysql database (which also runs the sphinx server)

consider sphinx aswell for search i have found off setting the search has also been fantastic shame the sphinx thread is not being looked at because a few bugs fixed and it will be the best thing around!

i found memcache better than APC for the datastore (taking the load from the apache server) but APC is awsome with the "plugin based template cache" i found this probably the best load reducer out of them all... and page load times are amazing.

im going to be adding a new server soon with lighttp to serve the static stuff as this looks like a nice way of doing stuff and heard alot of good reviews, also looking into putting the downloads onto another server aswell (lots of arguments for and against)

there is many things that can be done but you will need to try them for yourself believe me you will be adding alot in the next few years and testing things out

Regards
Mickie D

Zia
03 Mar 2007, 07:11
wel...Xcache is better tha eAcc/APC as opcode cacher..
now Xcache started to support vb datastore cache...
http://www.vbulletin.org/forum/showthread.php?t=141005

try it here

kmike
03 Mar 2007, 07:57
wel...Xcache is better tha eAcc/APC as opcode cacher..
FYI everyone: "better" as in "I couldn't figure out how to get APC and eAccelerator to work".

Zia
03 Mar 2007, 10:20
for Xcache
http://trac.lighttpd.net/xcache/

eoc_Jason
08 Mar 2007, 23:16
Been using APC, planning on switching to xcache after hearing so many good things about it. Also it seems APC development has kind of stopped (like so many before it)...

The *best* improvement I ever made was to use sphinx to replace the search. It alieviated a lot of the server load and is tons faster than the fulltext index search - most results are done in half a second or so.

Zia
09 Mar 2007, 06:47
Xcache is doing too good....
it reduced more load than eAcc reduced....
65 clinet online[user+guest+search engn]
and : [Server Loads: 0.13 0.08 : 0.08]

BamaStangGuy
18 Mar 2007, 22:32
My next project after template cache + sphinx search will be memcached for vbulletin (caching everything that is possible, from styles to languages, forums, threads, posts, users).

Have you made any progress on this? Finding good information on caching more of vBulletin into memcached is near impossible.

Zia
20 Mar 2007, 18:29
http://www.vbulletin.org/forum/showthread.php?t=141005

BamaStangGuy
20 Mar 2007, 23:50
http://www.vbulletin.org/forum/showthread.php?t=141005
I don't know who that link is for but I didn't ask anything related to Xcache. I wanted to know if Orban had made any progress on memcached with vBulletin.

Mickie D
21 Mar 2007, 12:48
i use memcached with the datastore
APC for php caching
have the templates stored as php files
sphinx server for searching

this is the best i have ever had my server running and with 400-600 concurrent users it has no probs at all

orban
23 Mar 2007, 18:08
I don't know who that link is for but I didn't ask anything related to Xcache. I wanted to know if Orban had made any progress on memcached with vBulletin.

Not really :/

I just don't really feel like modifying vB more and more when you can probably write a completely new forum software from scratch with all the time I invested ;)

gabrielt
19 Jun 2007, 23:47
The *best* improvement I ever made was to use sphinx to replace the search.

Can someone talk more about this? It seems promising.

Gabriel.