Machine is booting to maintenance mode.

cheetobandito · July 24, 2008, 3:28pm

I had a power failure the other day and when my relatively new Solaris 10 machine rebooted it is thrown into maintenance mode.

I've found the following lines in the /var/adm/messages file, I'm assuming this is the root cause of the problem. However, I don't have the slightest idea on how to correct it.

Jul 18 17:14:55 SunFile svc.startd[7]: [ID 652011 daemon.warning] svc:/network/rpc/bind:default: Method "/lib/svc/method/rpc-bind start" failed with exit status 1.
Jul 18 17:14:56 SunFile rpcbind: [ID 126418 daemon.error] could not read /etc/netconfig
Jul 18 17:14:56 SunFile svc.startd[7]: [ID 652011 daemon.warning] svc:/network/rpc/bind:default: Method "/lib/svc/method/rpc-bind start" failed with exit status 1.
Jul 18 17:14:56 SunFile rpcbind: [ID 126418 daemon.error] could not read /etc/netconfig
Jul 18 17:14:56 SunFile svc.startd[7]: [ID 652011 daemon.warning] svc:/network/rpc/bind:default: Method "/lib/svc/method/rpc-bind start" failed with exit status 1.
Jul 18 17:14:56 SunFile svc.startd[7]: [ID 748625 daemon.error] network/rpc/bind:default failed: transitioned to maintenance (see 'svcs -xv' for details)
Jul 18 17:15:00 SunFile sendmail[333]: [ID 702911 mail.crit] My unqualified host name (SunFile) unknown; sleeping for retry
Jul 18 17:15:00 SunFile sendmail[334]: [ID 702911 mail.crit] My unqualified host name (SunFile) unknown; sleeping for retry
Jul 18 17:15:02 SunFile inetd[310]: [ID 702911 daemon.error] Failed to register version 1 of RPC service instance svc:/application/font/stfsloader:default, netid ticotsord
Jul 18 17:15:02 SunFile inetd[310]: [ID 702911 daemon.error] Too many bind failures for instance svc:/application/font/stfsloader:default, transitioning to maintenance
Jul 18 17:15:02 SunFile inetd[310]: [ID 702911 daemon.error] Failed to register version 1 of RPC service instance svc:/network/security/ktkt_warn:default, netid ticotsord
Jul 18 17:15:02 SunFile inetd[310]: [ID 702911 daemon.error] Too many bind failures for instance svc:/network/security/ktkt_warn:default, transitioning to maintenance
Jul 18 17:15:03 SunFile inetd[310]: [ID 702911 daemon.error] Failed to register version 1 of RPC service instance svc:/network/rpc-100235_1/rpc_ticotsord:default, netid ticotsord
Jul 18 17:15:03 SunFile inetd[310]: [ID 702911 daemon.error] Too many bind failures for instance svc:/network/rpc-100235_1/rpc_ticotsord:default, transitioning to maintenance
Jul 18 17:15:04 SunFile kcfd[158]: [ID 418942 user.error] kcfd: unable to open certificate dir /etc/crypto/certs: Permission denied 
Jul 18 17:15:04 SunFile kcfd[158]: [ID 821307 user.error] kcfd: unable to find a certificate for DN: O=Sun Microsystems Inc, OU=Solaris Cryptographic Framework, CN=SunOS 5.10
Jul 18 17:15:04 SunFile fmd[344]: [ID 234283 user.error] libpkcs11: /usr/lib/security/pkcs11_softtoken.so unexpected failure in ELF signature verification. System may have been tampered with. See cryptoadm(1M). Skipping this plug-in.
Jul 18 17:16:00 SunFile sendmail[333]: [ID 702911 mail.alert] unable to qualify my own domain name (SunFile) -- using short name

Any ideas?

reborg · July 24, 2008, 3:32pm

It looks like that is the problem.

Have a look at the logs in /var/svc/log, and see if you can find any more deatil about why rpc/bind is not starting.

cheetobandito · July 24, 2008, 3:43pm

network-rpc-bind-default.log only shows that the service exited with a status of 1, 6 times.

Is "/lib/svc/method/rpc-bind" a generic file I can replace with a copy from the CD?

reborg · July 24, 2008, 4:03pm

Sorry, I missed a line from the log, is /etc/netconfig missing on your machine?

cheetobandito · July 24, 2008, 4:07pm

No, that's there. Here's what it looks like:

# cat netconfig
#pragma ident   "@(#)netconfig  1.16    99/10/25 SMI"
#
# The "Network Configuration" File.
#
# Each entry is of the form:
#
#       <network_id> <semantics> <flags> <protofamily> <protoname> \
#               <device> <nametoaddr_libs>
#
# The "-" in <nametoaddr_libs> for inet family transports indicates
# redirection to the name service switch policies for "hosts" and
# "services". The "-" may be replaced by nametoaddr libraries that
# comply with the SVr4 specs, in which case the name service switch
# will not be used for netdir_getbyname, netdir_getbyaddr,
# gethostbyname, gethostbyaddr, getservbyname, and getservbyport.
# There are no nametoaddr_libs for the inet family in Solaris anymore.
#
udp6       tpi_clts      v     inet6   udp    /dev/udp6       -
tcp6       tpi_cots_ord  v     inet6   tcp    /dev/tcp6       -
udp        tpi_clts      v     inet    udp    /dev/udp        -
tcp        tpi_cots_ord  v     inet    tcp    /dev/tcp        -
rawip      tpi_raw       -     inet    -      /dev/rawip      -
ticlts     tpi_clts      v    loopback -      /dev/ticlts     straddr.so
ticotsord  tpi_cots_ord  v    loopback -      /dev/ticotsord  straddr.so
ticots     tpi_cots      v    loopback -      /dev/ticots     straddr.so
#

Thanks for helping.

reborg · July 24, 2008, 6:04pm

What are the permissions on the file.

The file should be owned by root, group sys and have permissions 644

cheetobandito · July 25, 2008, 9:21am

Permissions are exactly how you described.

cheetobandito · July 25, 2008, 9:26am

Also, I just noticed when I tried to reboot, showmount errors and says rpcbind: unable to receive

reborg · July 25, 2008, 12:06pm

ok, a few more questions.

What update release of Solaris 10 is this? (cat /etc/release)

What is the output of "svcs -xv"?

What is the console output if any?

Is the root disk mounted read/write or read only?

What happens if you do a mount -a ?

cheetobandito · July 28, 2008, 11:50am

Thanks reborg, I'm going to try and cover everything:
# mount -a

# mount -a
mount: /tmp is already mounted or swap is busy
mount: /dev/md/dsk/d55 is already mounted or /share is busy
mount: /dev/dsk/c2t0d0s7 is already mounted or /export/home is busy

# svcs -vx

# svcs -vx
svc:/network/rpc/bind:default (RPC bindings)
 State: maintenance since Fri Jul 25 09:34:09 2008
Reason: Start method failed repeatedly, last exited with status 1.
   See: http://sun.com/msg/SMF-8000-KS
   See: man -M /usr/share/man -s 1M rpcbind
   See: /var/svc/log/network-rpc-bind:default.log
Impact: 27 dependent services are not running:
        svc:/network/rpc/gss:default
        svc:/network/nfs/client:default
        svc:/milestone/multi-user:default
        svc:/system/webconsole:console
        svc:/milestone/multi-user-server:default
        svc:/system/basicreg:default
        svc:/system/zones:default
        svc:/application/graphical-login/cde-login:default
        svc:/application/cde-printinfo:default
        svc:/system/filesystem/autofs:default
        svc:/network/rpc/rstat:default
        svc:/network/rpc/metamed:default
        svc:/network/nfs/nlockmgr:default
        svc:/network/nfs/status:default
        svc:/network/nfs/cbd:default
        svc:/network/nfs/mapid:default
        svc:/network/rpc/meta:default
        svc:/system/mdmonitor:default
        svc:/application/management/dmi:default
        svc:/network/rpc/cde-ttdbserver:tcp
        svc:/network/rpc/metamh:default
        svc:/network/rpc/mdcomm:default
        svc:/network/rpc/smserver:default
        svc:/system/filesystem/volfs:default
        svc:/network/rpc/rusers:default
        svc:/network/nfs/rquota:default
        svc:/network/rpc/cde-calendar-manager:default

svc:/application/font/stfsloader:default (Standard Type Services Framework (STSF
) Font Server loader)
 State: maintenance since Fri Jul 25 09:34:15 2008
Reason: Restarter svc:/network/inetd:default gave no explanation.
   See: http://sun.com/msg/SMF-8000-9C
Impact: This service is not running.

svc:/network/security/ktkt_warn:default (Kerberos V5 warning messages daemon)
 State: maintenance since Fri Jul 25 09:34:16 2008
Reason: Restarter svc:/network/inetd:default gave no explanation.
   See: http://sun.com/msg/SMF-8000-9C
   See: man -M /usr/share/man -s 1M ktkt_warnd
Impact: This service is not running.

svc:/network/rpc-100235_1/rpc_ticotsord:default (100235)
 State: maintenance since Fri Jul 25 09:34:16 2008
Reason: Restarter svc:/network/inetd:default gave no explanation.
   See: http://sun.com/msg/SMF-8000-9C
Impact: This service is not running.

svc:/application/print/ipp-listener:default (Internet Print Protocol Listening S
ervice)
 State: maintenance since Fri Jul 25 17:57:23 2008
Reason: Method failed.
   See: http://sun.com/msg/SMF-8000-8Q
   See: man -M /usr/share/man -s 4 mod_ipp
   See: /var/svc/log/application-print-ipp-listener:default.log
Impact: This service is not running.

# cat /etc/release

# cat /etc/release
                       Solaris 10 11/06 s10s_u3wos_10 SPARC
           Copyright 2006 Sun Microsystems, Inc.  All Rights Reserved.
                        Use is subject to license terms.
                           Assembled 14 November 2006

#mount

# mount
/ on /dev/md/dsk/d0 read/write/setuid/devices/intr/largefiles/logging/xattr/oner
ror=panic/dev=1540000 on Fri Jul 25 09:32:41 2008
/devices on /devices read/write/setuid/devices/dev=53c0000 on Fri Jul 25 09:31:4
0 2008
/system/contract on ctfs read/write/setuid/devices/dev=5400001 on Fri Jul 25 09:
31:40 2008
/proc on proc read/write/setuid/devices/dev=5440000 on Fri Jul 25 09:31:40 2008
/etc/mnttab on mnttab read/write/setuid/devices/dev=5480001 on Fri Jul 25 09:31:
40 2008
/etc/svc/volatile on swap read/write/setuid/devices/xattr/dev=54c0001 on Fri Jul
 25 09:31:40 2008
/system/object on objfs read/write/setuid/devices/dev=5500001 on Fri Jul 25 09:3
1:40 2008
/platform/sun4u-us3/lib/libc_psr.so.1 on /platform/sun4u-us3/lib/libc_psr/libc_p
sr_hwcap1.so.1 read/write/setuid/devices/dev=1540000 on Fri Jul 25 09:32:35 2008
/platform/sun4u-us3/lib/sparcv9/libc_psr.so.1 on /platform/sun4u-us3/lib/sparcv9
/libc_psr/libc_psr_hwcap1.so.1 read/write/setuid/devices/dev=1540000 on Fri Jul
25 09:32:35 2008
/dev/fd on fd read/write/setuid/devices/dev=56c0001 on Fri Jul 25 09:32:42 2008
/tmp on swap read/write/setuid/devices/xattr/dev=54c0002 on Fri Jul 25 09:33:03
2008
/var/run on swap read/write/setuid/devices/xattr/dev=54c0003 on Fri Jul 25 09:33
:03 2008
/share on /dev/md/dsk/d55 read/write/setuid/devices/intr/largefiles/logging/xatt
r/onerror=panic/dev=1540037 on Fri Jul 25 09:34:08 2008
/export/home on /dev/dsk/c2t0d0s7 read/write/setuid/devices/intr/largefiles/logg
ing/xattr/onerror=panic/dev=1d8000f on Fri Jul 25 09:34:08 2008