New RunFirst Payload Message TimeHas Data?Ends with CPU Crash?Cause of run start?Notes

103116/12/2006 20:03:54NoYes -- Dec 16 20:04:15usbext01 --> usbext02 -- Seemed to mount fine but then CPU hung when first writing?

103216/12/2006 20:05:45YesNoNext Boot

103316/12/2006 21:12:33YesNousbint01 --> usbint02

103419/12/2006 11:20:02YesNousbext02 --> usbext03No Magnetometer -- Dec 19 11:20:23 flight kernel: usb-uhci.c: ENXIO 80004c80, flags 0, urb d52c3900, burb d52c3f80
Dec 19 11:20:23 flight Hkd[18264]: open /dev/ttyUSB1: No such device or address

103519/12/2006 11:46:18YesNousbint02 --> usbint03No Magnetometer

103620/12/2006 01:59:38YesNozeus01 --> zeus02No Magnetometer

103721/12/2006 12:42:56YesNousbext03 --> usbext04No Magnetometer

103821/12/2006 13:07:50YesNousbint03 --> usbint04No Magnetometer

103922/12/2006 05:25:04YesNozeus02 --> zeus03No Magnetometer. zeus02 was not properly cleared before flight

104023/12/2006 17:56:04YesNousbext04 --> usbext05No Magnetometer

104123/12/2006 18:58:37YesNousbint04 --> usbint05No Magnetometer

104226/12/2006 08:29:13YesNousbext05 -- > usbext06No Magnetometer

104326/12/2006 08:52:45YesNousbint05 --> usbint06No Magnetometer

104428/12/2006 13:59:15YesNousbext06 --> usbext07No Magnetometer, blade drive errors

104528/12/2006 14:26:10YesNousbint06 --> usbint07No Magnetometer

104629/12/2006 03:16:07YesNozeus03 --> zeus04No Magnetometer, blade drive errors (hdm)

104730/12/2006 11:24:50YesNoCmd 003 -- Start New RunNo Magnetometer

104830/12/2006 16:26:38YesNousbext07 --> usbext08No Magnetometer, blade drive errors (hdm)

104930/12/2006 16:46:09YesNousbint07 --> usbint08No Magnetometer, blade drive errors (hdm), Dec 31 05:48:16 flight Acqd[12534]: Timed out waiting for EVT_RDY flag

105031/12/2006 08:34:47YesNoCmd 003 -- Start New RunNo Magnetometer

105131/12/2006 09:28:52YesNoCmd 003 -- Start New RunNo Magnetometer

105231/12/2006 15:39:41YesNoCmd 201 -- Clear RamdiskNo Magnetometer

105331/12/2006 17:39:26Yes (but in 1052 on USBs)NoCmd 130 -- Reboothdm errors during boot, Magnetometer back? shutdown at Dec 31 17:37:46, first time Dec 31 01:42:42 flight syslogd 1.4.1: restart.

105431/12/2006 22:38:37YesNoCmd 003 -- Start New Run

105501/01/2007 04:37:05YesNoCmd 003 -- Start New Run

105601/01/2007 09:28:59YesNoCmd 003 -- Start New Run

105701/01/2007 15:08:36YesNousbext08 -> usbext09No Magnetometer

105801/01/2007 15:36:05YesNousbint08 --> usbint09No Magnetometer

105901/01/2007 17:20:03YesNoCmd 003 -- Start New RunNo Magnetometer

106001/01/2007 23:40:20YesNoCmd 003 -- Start New RunNo Magnetometer

106102/01/2007 04:35:59YesNoCmd 003 -- Start New RunNo Magnetometer

106202/01/2007 10:36:17YesNoCmd 003 -- Start New RunNo Magnetometer

106302/01/2007 17:35:01YesNoCmd 003 -- Start New RunNo Magnetometer

106403/01/2007 00:20:22YesNoCmd 003 -- Start New RunNo Magnetometer

106503/01/2007 05:40:11YesNoCmd 003 -- Start New RunNo Magnetometer

106603/01/2007 11:31:17YesNoCmd 003 -- Start New RunNo Magnetometer

106703/01/2007 16:21:13YesNousbext09 --> usbext10No Magnetometer

106803/01/2007 16:45:57YesNousbint09 --> usbint10No Magnetometer

106903/01/2007 23:23:10YesNoCmd 003 -- Start New RunNo Magnetometer, Playbackd running and making a mess of everything, LOSd also enabled part of the time

107004/01/2007 12:08:57YesNoCmd 003 -- Start New RunNo Magnetometer, many corrupt GPS messages

107104/01/2007 16:23:30Yes (no events stored as Archived wasn't running)NoCmd 003 -- Start New RunNo Magnetometer, Jan 4 16:23:42 flight Archived: Archived: fatal: failed to become a daemon: Resource temporarily unavailable. Many attempts to restart Acqd, problem was Archived wasn't runnings

107204/01/2007 19:20:21Yes (no events stored as Archived wasn't running)NoCmd 003 -- Start New RunNo Magnetometer, Archived: Archived: fatal: failed to become a daemon: Resource temporarily unavailable

107304/01/2007 20:20:50YesNoCmd 130 -- RebootReboot at 04/01/2007 20:19:08, Clock reset to Jan 1 was there a power cycle? peterHappyTime=20:20:50, G12 reset CPU time

107405/01/2007 12:02:45YesNoCmd 003 -- Start New RunBlade Errors hdp -- many thousands of them

107506/01/2007 00:02:20YesNoCmd 003 -- Start New RunBlade Errors on hdp continue -- Cmds 138 and 139 sent to disable event writing to blade -- Jan 6 01:03:00 flight Archived: Archived: fatal: failed to become a daemon: Resource temporarily unavailable -- Jan 6 01:04:18 flight Archived[26101]: Archived terminating

107606/01/2007 01:11:31YesNoCmd 003 -- Start New RunBlade Errors go away. Then at 01:54:59 send Cmd 139 to re-enable writing hk to blade. Blade errors on hdp return.

107706/01/2007 01:56:35Yes (no events)NoCmd 003 -- Start New RunBlade Errors abound, No whiteheat send Cmd 139 to disable writing hk to blade -- Jan 6 01:56:35 flight Archived: Archived: fatal: failed to become a daemon: Resource temporarily unavailable

107806/01/2007 02:08:47Yes (no events)NoCmd 003 -- Start New RunJan 6 02:08:47 flight Archived: Archived: fatal: failed to become a daemon: Resource temporarily unavailable

107906/01/2007 02:22:56YesNoCmd 003 -- Start New RunJan 6 02:22:57 flight Archived: Archived: fatal: failed to become a daemon: Resource temporarily unavailable -- At 02:47:30 Sent Cmd 127 reallyKillProgram Archived -- Starts working

108006/01/2007 08:05:37YesMaybe -- No shutdown, no error message, just turns offCmd 003 -- Start New RunNo magnetometer, last message Jan 6 12:56:51 flight Monitord[1907]: Telemetry not keeping up removing 308 links from queue /tmp/anita/telem/head

108106/01/2007 12:58:10NoYes -- Immediately after mounting the USBsCrash and CPU bootJan 6 12:58:10 flight logger: Date set from /var/log/peterHappyFile, last messages: Jan 6 13:00:03 flight kernel: EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,1), internal journal
Jan 6 13:00:03 flight kernel: EXT3-fs: recovery complete.
Jan 6 13:00:03 flight kernel: EXT3-fs: mounted filesystem with ordered data mode.

108206/01/2007 12:58:10YesYesCrash and CPU bootSame time from the peterHappyFile as run1081, Jan 6 13:07:07 flight Eventd[4480]: Received sig 11 -- will exit immeadiately, CPU crashes in middle of starting a new run (no errors)

108306/01/2007 14:13:13YesYesCrash and CPU bootJan 6 14:13:13 flight logger: Date set from /var/log/peterHappyFile, Last messgae before crash Jan 6 14:38:04 flight Monitord[4328]: Telemetry not keeping up removing 343 event links from queue /tmp/anita/telem/event/pri6/link

108406/01/2007 14:40:15YesYesCrash and CPU bootMany GPS message errors, Again no warning last message Jan 6 14:57:04 flight Monitord[4328]: Telemetry not keeping up removing 318 event links from queue /tmp/anita/telem/event/pri6/link

108506/01/2007 14:59:17Yes (no events)YesCrash and CPU bootCrashes with no warning. Last message Jan 6 15:06:28 flight Acqd[4282]: writeAntTrigMask: GPIO8 on, so mask should be set to 0000 0x000000ff.

108606/01/2007 15:09:19YesYesCrash and CPU bootMagnetometer check sum errors, Eventd crashing, Last message Jan 6 15:43:08 flight Hkd[4197]: Bad Magnetometer Checksum -0.10382 -0.49621 34^M ^M >D^M -0.117524 -0.49^A

108706/01/2007 15:44:21Yes (no events)YesCrash and CPU bootLast message (5 seconds after starting Acqd and friends) Jan 6 15:46:29 flight ntpd[4598]: frequency initialized 19.238 from /etc/ntp/drift

108806/01/2007 15:48:22Yes (no events)YesCrash and CPU bootLast message (5 seconds after starting Acqd and friends) Jan 6 15:50:32 flight kernel: set_rtc_mmss: can't update from 4 to 50

108906/01/2007 15:52:25NoYesCrash and CPU bootLast message: Jan 6 15:53:38 flight kernel: EXT3-fs: mounted filesystem with ordered data mode.

109006/01/2007 15:52:25Yes (no events)YesCrash and CPU bootLast message (5 seconds after starting Acqd): Jan 6 15:54:33 flight kernel: set_rtc_mmss: can't update from 4 to 54

109106/01/2007 15:56:26Yes (no events)YesCrash and CPU bootLast message: Jan 6 16:06:59 flight Eventd[4326]: Eventd terminating

109206/01/2007 16:08:27Yes (no events)Yes Crash and CPU bootLast message: Jan 6 16:14:59 flight Acqd[4217]: writeAntTrigMask: GPIO8 on, so mask should be set to 0000 0x000000ff.

109306/01/2007 16:16:29NoYesCrash and CPU bootLast Message: Jan 6 16:17:41 flight kernel: EXT3-fs: mounted filesystem with ordered data mode.

109406/01/2007 16:16:29NoYesCrash and CPU bootTried to send commands early. Last Message: Jan 6 16:18:30 flight Cmdd[4122]: Error executing cmd: 174 8 0

109506/01/2007 16:20:30NoYesCrash and CPU bootLast message: Jan 6 16:21:30 flight kernel: sda: sda1

109606/01/2007 16:20:30NoYesCrash and CPU bootLast Message: Jan 6 16:22:32 flight GPSd[4482]: Sent 272 bytes to G12 serial port

109706/01/2007 16:24:31YesYesCrash and CPU bootGot data! Last Message: Jan 6 19:20:07 flight Monitord[4494]: Telemetry not keeping up removing 298 event links from queue /tmp/anita/telem/event/pri6/link

109806/01/2007 19:21:38YesYesCrash and CPU bootGot data. Last Message: Jan 6 19:30:11 flight Eventd[4393]: Eventd terminating

109906/01/2007 19:31:40NoYesCrash and CPU bootLast Message: Jan 6 19:32:55 flight kernel: EXT3-fs: mounted filesystem with ordered data mode.

110006/01/2007 19:31:40YesYesCrash and CPU bootGot Data. Last message: Jan 6 20:42:36 flight Monitord[4474]: Telemetry not keeping up removing 293 event links from queue /tmp/anita/telem/event/pri6/link

110106/01/2007 20:43:44YesYesCrash and CPU bootGot Data. Last message: Jan 6 23:00:48 flight Monitord[4296]: Telemetry not keeping up removing 316 links from queue /tmp/anita/telem/head

110206/01/2007 23:02:52NoYesCrash and CPU bootLast Message: Jan 6 23:04:45 flight kernel: EXT3-fs: mounted filesystem with ordered data mode.

110306/01/2007 23:02:52Yes (no events)YesCrash and CPU bootLast Message: Jan 6 23:05:04 flight ntpd[4472]: frequency initialized 19.238 from /etc/ntp/drift

110406/01/2007 23:06:54YesYesCrash and CPU bootLast Message: Jan 6 23:36:11 flight Monitord[4462]: Telemetry not keeping up removing 220 event links from queue /tmp/anita/telem/event/pri6/link

110506/01/2007 23:38:56YesYesCrash and CPU bootLast Message: Jan 6 23:51:33 flight Monitord[4325]: Telemetry not keeping up removing 287 event links from queue /tmp/anita/telem/event/pri6/link

110606/01/2007 23:53:00YesYesCrash and CPU bootLast message: Jan 7 00:48:30 flight Monitord[4298]: Telemetry not keeping up removing 278 event links from queue /tmp/anita/telem/event/pri6/link

110707/01/2007 00:51:03Yes (no events)YesCrash and CPU bootLast message: Jan 7 00:58:19 flight kernel: set_rtc_mmss: can't update from 9 to 58

110807/01/2007 01:00:05YesYesCrash and CPU bootLast message: Jan 7 01:38:20 flight Eventd[4360]: GPS overload junking 398 times

110907/01/2007 01:40:08YesYesCrash and CPU bootLast message: Jan 7 05:39:14 flight Monitord[4491]: Telemetry not keeping up removing 264 event links from queue /tmp/anita/telem/event/pri6/link

111007/01/2007 05:42:16YesNoCrash and CPU bootEnded when usbext10 was full

111107/01/2007 07:02:17YesNousbext10 --> usb ext11Ended when usbint10 was full

111207/01/2007 07:49:10YesYesusbint10 --> usbint11Last message: Jan 7 07:54:50 flight Eventd[11343]: GPS overload junking 400 times

111307/01/2007 07:56:22YesYesCrash and CPU bootLast message: Jan 7 08:41:58 flight Monitord[4554]: Telemetry not keeping up removing 259 links from queue /tmp/anita/telem/head

111407/01/2007 08:43:24YesYesCrash and CPU bootLast message: Jan 7 10:47:40 flight Monitord[4235]: Telemetry not keeping up removing 153 links from queue /tmp/anita/telem/house/gps/adu5/pat

111507/01/2007 10:50:28YesYesCrash and CPU bootLast message: Jan 7 11:09:58 flight Acqd[4380]: writeAntTrigMask: GPIO8 on, so mask should be set to 0000 0x000000ff.