[vudutu]

It looks like my server is developing a chronic crash condition and
slipping into never never lan. My usually docile OSX rack server (Dual 2 gig g5 running 10.4.2) is puking all over itself, it restarts itself and this error shows up in the var/system.log, no hints in crashguard. This has happened three times this week, no recent changes in config.

This is a pretty simple setup, AFP and Open Directory are the only
services running. A couple of hundred users total, only about 20 on each
time it crashed.

Oct 24 12:30:24 localhost kernel[0]: ApplePMU:MU
FORCED SHUTDOWN, CAUSE = -93

A Google search bring up a number of incidents, none with conclusive
solutions.

From the looks of the logs and the time that the Apple File Server
crashed then took down the OS, one minute I was watching AFP server go into the ozone the next minute the screen went to black and the white on black “you must restart” error came up. Note the last line of the system log “Server crashed and exited with status 11”.

The Panic.log is the most interesting, all four crashes are almost identical except for the Exception state.

I have Googled the daylights out of this problem and I am posting here because this post looks very similar to my problem.
Any ideas?

Note! Panic, system and crash logs are below
Thanks
Craig

************Here is the panic log************

Mon Sep 26 16:07:56 2005
panic(cpu 0 caller 0x000E6D70): vnode_put(3ac7738): iocount < 1
Latest stack backtrace for cpu 0:
Backtrace:
0x00095544 0x00095A5C 0x0002683C 0x000E6D70 0x000E6D1C 0x000D3798
0x002A7A94 0x000ABCB0
0x093C7374
Proceeding back via exception chain:
Exception state (sv=0x448AB500)
PC=0x9001BF20; MSR=0x0000F030; DAR=0x4614FFBA; DSISR=0x40000000;
LR=0x90B0BA6C; R1=0xF12A28C0; XCP=0x00000030 (0xC00 – System call)

Kernel version:
Darwin Kernel Version 8.2.0: Fri Jun 24 17:46:54 PDT 2005;
rootnu-792.2.4.obj~3/RELEASE_PPC
*********

Thu Oct 20 17:21:42 2005
panic(cpu 0 caller 0x000E6D70): vnode_put(3ac7738): iocount < 1
Latest stack backtrace for cpu 0:
Backtrace:
0x00095544 0x00095A5C 0x0002683C 0x000E6D70 0x000E6D1C 0x000D3798
0x002A7A94 0x000ABCB0
0x093C7374
Proceeding back via exception chain:
Exception state (sv=0x448AB500)
PC=0x9001BF20; MSR=0x0000F030; DAR=0x4614FFBA; DSISR=0x40000000;
LR=0x90B0BA6C; R1=0xF12A28C0; XCP=0x00000030 (0xC00 – System call)

Kernel version:
Darwin Kernel Version 8.2.0: Fri Jun 24 17:46:54 PDT 2005;
rootnu-792.2.4.obj~3/RELEASE_PPC
*********

Mon Oct 24 12:30:28 2005
panic(cpu 0 caller 0x000E6D70): vnode_put(339ce70): iocount < 1
Latest stack backtrace for cpu 0:
Backtrace:
0x00095544 0x00095A5C 0x0002683C 0x000E6D70 0x000E6D1C 0x000D3798
0x002A7A94 0x000ABCB0
0xFFFFFFFF
Proceeding back via exception chain:
Exception state (sv=0x4A59CC80)
PC=0x9001BF20; MSR=0x0000F030; DAR=0xE077B000; DSISR=0x42000000;
LR=0x90B0BA6C; R1=0xF068A8C0; XCP=0x00000030 (0xC00 – System call)

Kernel version:
Darwin Kernel Version 8.2.0: Fri Jun 24 17:46:54 PDT 2005;
rootnu-792.2.4.obj~3/RELEASE_PPC
*********

Tue Oct 25 11:39:33 2005
panic(cpu 1 caller 0x000E6D70): vnode_put(42b5840): iocount < 1
Latest stack backtrace for cpu 1:
Backtrace:
0x00095544 0x00095A5C 0x0002683C 0x000E6D70 0x000E6D1C 0x000D3798
0x002A7A94 0x000ABCB0
0x7BD04360
Proceeding back via exception chain:
Exception state (sv=0x449E0C80)
PC=0x9001BF20; MSR=0x0000D030; DAR=0x00787000; DSISR=0x42000000;
LR=0x90B0BA6C; R1=0xF0B948C0; XCP=0x00000030 (0xC00 – System call)

Kernel version:
Darwin Kernel Version 8.2.0: Fri Jun 24 17:46:54 PDT 2005;
rootnu-792.2.4.obj~3/RELEASE_PPC
*********

************NOTE THIS TEXT IS FROM – From Apple File server crash log************

Date/Time: 2005-10-25 11:40:05.755 -0400
OS Version: 10.4.2 (Build 8C47)
Report Version: 3
Command: AppleFileServer
Path: /usr/sbin/AppleFileServer
Parent: AppleFileServer [252]
Version: ??? (???)
PID: 253
Thread: 23
Exception: EXC_BAD_ACCESS (0x0001)
Codes: KERN_INVALID_ADDRESS (0x0001) at 0x007dd000

************NOTE THIS TEXT IS FROM- system.log************

Oct 25 11:39:26 localhost kernel[0]: standard timeslicing quantum is 10000
us
Oct 25 11:39:25 localhost mDNSResponder-107 (Mar 20 2005 20: 31:47)[46]:
starting
Oct 25 11:39:26 localhost kernel[0]: vm_page_bootstrap: 509506 free pages
Oct 25 11:39:26 localhost lookupd[42]: lookupd (version 365) starting –
Tue Oct 25 11:39:26 2005
Oct 25 11:39:26 localhost kernel[0]: mig_table_max_displ = 70
Oct 25 11:39:26 localhost kernel[0]: 98 prelinked modules
Oct 25 11:39:26 localhost kernel[0]: Copyright (c) 1982, 1986, 1989, 1991,
1993
Oct 25 11:39:26 localhost kernel[0]: The Regents of the University of
California. All rights reserved.
Oct 25 11:39:26 localhost watchdogtimerd: Automatic reboot timer enabled.
Oct 25 11:39:26 localhost kernel[0]: using 5242 buffer headers and 4096
cluster IO buffer headers
Oct 25 11:39:26 localhost kernel[0]: DART enabled
Oct 25 11:39:26 localhost kernel[0]: MacRISC4CPU: publishing BootCPU
Oct 25 11:39:26 localhost kernel[0]: Enabling ECC Error Notifications
Oct 25 11:39:26 localhost kernel[0]: FireWire (OHCI) Apple ID 42 built-in
now active, GUID 000d93ff feb125e2; max speed s800.
Oct 25 11:39:26 localhost kernel[0]: Security auditing service present
Oct 25 11:39:26 localhost kernel[0]: BSM auditing present
Oct 25 11:39:26 localhost kernel[0]: disabled
Oct 25 11:39:26 localhost kernel[0]: rooting via boot-uuid from /chosen:
21CC91DC-BFE5-34E9-896D-BD5111EAA88C
Oct 25 11:39:26 localhost kernel[0]: Waiting on ID=”0″>IOProviderClass ID=”1″>IOResourcesIOResourceMatch ID=”2″>boot-uuid-media
Oct 25 11:39:26 localhost kernel[0]: Got boot device =
IOService:/MacRISC4PE/ht@0,f2000000/AppleMacRiscHT/pci@7/IOPCI2PCIBridge/k2-sata-root@C/AppleK2SATARoot/k2-sata@0/AppleK2SATA/ATADeviceNub@0/IOATABlockStorageDriver/IOATABlockStorageDevice/IOBlockStorageDriver/Hitachi
HDS722525VLSA80 Media/IOApplePartitionScheme/Apple_HFS_Untitled_1@3
Oct 25 11:39:26 localhost kernel[0]: BSD root: disk0s3, major 14, minor 4
Oct 25 11:39:26 localhost kernel[0]: jnl: replay_journal: from: 7272448
to: 20358144 (joffset 0x750000)
Oct 25 11:39:26 localhost kernel[0]: hfs mount: enabling extended security
on SystemX
Oct 25 11:39:26 localhost kernel[0]: HFS: Removed 3 orphaned unlinked
files
Oct 25 11:39:26 localhost kernel[0]: Jettisoning kernel linker.
Oct 25 11:39:26 localhost kernel[0]: Resetting IOCatalogue.
Oct 25 11:39:26 localhost kernel[0]: Matching service count = 0
Oct 25 11:39:26 localhost kernel[0]: Matching service count = 11
Oct 25 11:39:26 localhost kernel[0]: Matching service count = 11
Oct 25 11:39:26 localhost kernel[0]: Matching service count = 11
Oct 25 11:39:26 localhost kernel[0]: Matching service count = 11
Oct 25 11:39:26 localhost kernel[0]: AppleRS232Serial: 44247020 80013020
chip base, virtual, physical
Oct 25 11:39:26 localhost kernel[0]: IOPlatformControl::registerDriver
Control Driver AppleSlewClock did not supply target-value, using default
Oct 25 11:39:26 localhost kernel[0]: BCM5701Enet: Ethernet address
00:0d:93:9c:1e:d4
Oct 25 11:39:26 localhost kernel[0]: BCM5701Enet: Ethernet address
00:0d:93:9c:1e:d5
Oct 25 11:39:26 localhost lookupd[61]: lookupd (version 365) starting –
Tue Oct 25 11:39:26 2005
Oct 25 11:39:26 localhost kernel[0]: jnl: replay_journal: from: 34000896
to: 34100224 (joffset 0xe90000)
Oct 25 11:39:26 localhost diskarbitrationd[36]: disk3s3 hfs
F36002D8-C85F-3F28-9EFD-F1E2DE126898 BigDisk465
/Volumes/BigDisk465
Oct 25 11:39:26 localhost kernel[0]: jnl: replay_journal: from: 14544896
to: 5208576 (joffset 0x750000)
Oct 25 11:39:26 localhost kernel[0]: jnl: replay_journal: from: 4548096
to: 22191104 (joffset 0x750000)
Oct 25 11:39:27 localhost diskarbitrationd[36]: disk0s3 hfs
21CC91DC-BFE5-34E9-896D-BD5111EAA88C SystemX /
Oct 25 11:39:28 localhost kernel[0]: AppleBCM5701Ethernet – en0 link
active, 100-Mbit, full duplex, no flow control
Oct 25 11:39:28 localhost configd[34]: AppleTalk startup
Oct 25 11:39:28 myserversname configd[34]: setting hostname to
“aacxserve.local”
Oct 25 11:39:28 myserversname kernel[0]: VTXP: vram [94000000:02000000]
Oct 25 11:39:28 myserversname servermgrd: cupsd’s bootstrap server port
not found
Oct 25 11:39:28 myserversname servermgrd: cupsd’s bootstrap server port
not found
Oct 25 11:39:28 myserversname servermgrd: cupsd’s bootstrap server port
not found
Oct 25 11:39:28 myserversname servermgrd: cupsd’s bootstrap server port
not found
Oct 25 11:39:29 myserversname
/System/Library/CoreServices/loginwindow.app/Contents/MacOS/loginwindow:
Login Window Application Started
Oct 25 11:39:29 myserversname mDNSResponder: Adding browse domain local.
Oct 25 11:39:29 myserversname loginwindow[97]: Login Window Started
Security Agent
Oct 25 11:39:29 myserversname myserversname
/System/Library/CoreServices/mcxd.app/Contents/MacOS/mcxd:
DSGetLocallyHostedNodeNames(): dsFindDirNode() == -14008
Oct 25 11:39:29 myserversname
/System/Library/CoreServices/mcxd.app/Contents/MacOS/mcxd:
DSGetSearchPath(): DSGetLocallyHostedNodeNames() == -14956
Oct 25 11:39:29 myserversname
/System/Library/CoreServices/mcxd.app/Contents/MacOS/mcxd:
DSGetCurrentConfigInfo(): DSGetSearchPath() == -14956
Oct 25 11:39:29 myserversname
/System/Library/CoreServices/mcxd.app/Contents/MacOS/mcxd:
DSGetCacheInfo(): DSGetCurrentConfigInfo() == -14956
Oct 25 11:39:29 myserversname
/System/Library/CoreServices/mcxd.app/Contents/MacOS/mcxd: ***
MCXD.getComputerInfo: Couldn’t get cache info -14956
Oct 25 11:39:29 myserversname kernel[0]: AppleBCM5701Ethernet – en0 link
active, 100-Mbit, full duplex, flow control enabled
Oct 25 11:39:31 myserversname kernel[0]: hfs mount: enabling extended
security on Faculty
Oct 25 11:39:31 myserversname diskarbitrationd[36]: disk1s3 hfs
220748BD-0F19-32A4-9F23-89C4B108BE16 Faculty
/Volumes/Faculty
Oct 25 11:39:31 myserversname launchd: Server 0 in bootstrap 1103 uid 0:
“/usr/sbin/lookupd”[61]: exited abnormally: Hangup
Oct 25 11:39:31 myserversname configd[34]: executing
/System/Library/SystemConfiguration/Kicker.bundle/Contents/Resources/enable-network
Oct 25 11:39:31 myserversname configd[34]: posting notification
com.apple.system.config.network_change
Oct 25 11:39:31 myserversname lookupd[109]: lookupd (version 365) starting
– Tue Oct 25 11:39:31 2005
Oct 25 11:39:31 myserversname configd[34]: setting hostname to
“aacxserve.artacademy.edu”
Oct 25 11:39:36 myserversname kernel[0]: hfs mount: enabling extended
security on Students
Oct 25 11:39:36 myserversname diskarbitrationd[36]: disk2s3 hfs
1B4B1971-43C2-3C99-B037-18B30AE34BD9 Students
/Volumes/Students
Oct 25 11:39:37 myserversname mDNSResponder: ERROR: Only name server
claiming responsibility for “_kerberos.aacxserve.” is “.”!
Oct 25 11:39:38 myserversname configd[34]: target=enable-network:
disabled
Oct 25 11:39:40 myserversname /usr/sbin/serialnumberd[201]: serialnumberd:
Firewall rule #1 added to allow port 626.
Oct 25 11:39:43 myserversname /usr/sbin/serveradmin:
servermgr_ipfilter:ipfw config:Noticeisabled firewall
Oct 25 11:39:50 myserversname configd[34]: AppleTalk startup failed,
status = 92 (retrying)
Oct 25 11:39:51 myserversname configd[34]: AppleTalk startup
Oct 25 11:39:53 myserversname DirectoryService[41]: Failed Authentication
return is being delayed due to over five recent auth failures for
username: myserveradmin.
Oct 25 11:39:57 myserversname configd[34]: AppleTalk startup complete
Oct 25 11:40:06 myserversname crashdump[283]: AppleFileServer crashed
Oct 25 11:40:07 myserversname crashdump[283]: crash report written to:
/Library/Logs/CrashReporter/AppleFileServer.crash.log
Oct 25 11:40:07 myserversname /usr/sbin/AppleFileServer: Server crashed
and exited with status 11.

[Author]

Posts