Problem with CACHEFS on Solaris 10

UNIX Solaris
1

Hi,

I am having a problem with getting cachefs to work in in disconnect mode.
I have 3 load balanced web servers that access the web content on a centralized NFS server. The content does not change very often and we want the web content available at all times,i.e. the NFS server goes down.
A previous SA had set up cachefs on each of the web servers but it has never worked as far as I know. Here are the results of a little test I ran to mimic what I am trying to achieve.

nfs-server # cd /export
nfs-server # mkdir files
nfs-server # cd files
nfs-server # date > a_file
nfs-server # ls -l
total 2
-rw-r--r--   1 root     root          29 Dec 15 10:12 a_file
nfs-server # share -o rw /export/files
nfs-server # share
-               /export/files   rw   ""


nfs-client # mkdir -p /home/remote_dir
nfs-client # mount nfs-server:/export/files /home/remote_dir
nfs-client # ls -l /home/remote_dir
total 2
-rw-r--r--   1 root     root          29 Dec 15 10:12 a_file

nfs-client # umount /home/remote_dir

nfs-client # cfsadmin -c /var/cachefs/caches/cache1

nfs-client # mkdir -p /var/cachefs/backpaths/remote_dir
nfs-client # mount -o vers=3 nfs-server:/export/files /var/cachefs/backpaths/remote_dir

nfs-client # mount -F cachefs -o backfstype=nfs,\
backpath=/var/cachefs/backpaths/remote_dir,\
cachedir=/var/cachefs/caches/cache1,\
demandconst \
nfs-server:/export/files /home/remote_dir

nfs-client # tail /etc/mnttab

nfs-server:/export/files  /var/cachefs/backpaths/remote_dir       nfs     vers=3,xattr,dev=4b40006        1260891074
/var/cachefs/backpaths/remote_dir       /home/remote_dir        
cachefs backfstype=nfs,backpath=/var/cachefs/backpaths/remote_dir,cachedir=/var/cachefs/caches/cache1,demandconst,dev=4bc0004
   1260891285

nfs-client # ls -l /home/remote_dir
total 2
-rw-r--r--   1 root     root          29 Dec 15 10:12 a_file


nfs-server # unshare /export/files


nfs-client # ls -l /home/remote_dir
/home/remote_dir: Stale NFS file handle
total 2

nfs-client # ps -ef | grep cache
    root  8065  8031   0 10:40:21 pts/2       0:00 grep cache
    root  7658   356   0 12:08:32 ?           0:00 /usr/lib/fs/cachefs/cachefsd


nfs-server # cat /etc/release
                        Solaris 10 11/06 s10x_u3wos_10 X86
           Copyright 2006 Sun Microsystems, Inc.  All Rights Reserved.
                        Use is subject to license terms.
                           Assembled 14 November 2006

nfs-client # cat /etc/release
                       Solaris 10 10/09 s10x_u8wos_08a X86
           Copyright 2009 Sun Microsystems, Inc.  All Rights Reserved.
                        Use is subject to license terms.
                           Assembled 16 September 2009

Any insight would be appreciated. A solution using cachefs would be ideal.

2

what was the output of cachefsstat /mount-point after you ran mount command?
Also set this, do your same steps again and post the output
$ cachefslog -f log-file-path /mount-point

3 
nfs-client # cachefslog -f /var/log/cachefs_log /home/remote_dir
/var/log/cachefs_log: /home/remote_dir
nfs-client # cachefslog /home/remote_dir
/var/log/cachefs_log: /home/remote_dir
nfs-client # cachefsstat /home/remote_dir

    /home/remote_dir
                 cache hit rate:   100% (0 hits, 0 misses)
             consistency checks:      0 (0 pass, 0 fail)
                       modifies:      0
             garbage collection:      0
nfs-client # ssh nfs-server "unshare /export/files"
Password:
nfs-client # cachefsstat /home/remote_dir

    /home/remote_dir
                 cache hit rate:   100% (0 hits, 0 misses)
             consistency checks:      0 (0 pass, 0 fail)
                       modifies:      0
             garbage collection:      0
nfs-client # ls -l /home/remote_dir
ls: can't read ACL on /home/remote_dir: Stale NFS file handle
nfs-client # ssh nfs-server "share -o rw /export/files"
Password:
nfs-client # ls -l /home/remote_dir
total 2
-rw-r--r--   1 root     root          29 Dec 15 10:12 a_file
nfs-client # cachefsstat /home/remote_dir

    /home/remote_dir
                 cache hit rate:    50% (3 hits, 3 misses)
             consistency checks:      2 (2 pass, 0 fail)
                       modifies:      0
             garbage collection:      0

On other piece of info the mount point /home/remote_dir is in a ZFS file system, if that makes any difference.

4

Cachefs is doomed: