Log file growing huge within hours

Questions and information regarding the Mac OS X desktop client - Fragen und Informationen zum Mac OS X Desktop-Client

Log file growing huge within hours

Postby systemverwalter » 02 Mar 2010, 11:37

Hi,

sadly I can't currently use TeamDrive as opening it will fill our Servers hard drive within a day.
The log files placed in /Library/Application\ Support/TeamDrive/logs reach 20 GB within a few hours.

I renamed the .td2/loglevel_debug to loglevel_none but it is automatically renamed back by starting the app.

I appended the reoccurring lines of the log below.
The environment is:
Mac OS X Snow Leopard Server on a Mac Pro
The teamdrive shard folder contains files that are also shared in the local network

My question is obviously:
a) !! How can I temporarily get TeamDrive back to work (without flooding my drive)?
b) What could be the cause of the problem that produces all the log entries?

All the best
Christoph

FSEventListener_log.txt:
25.02.10 13:27:34:761 [Debug] [ 1 : FSEventListener ] [ CBasicThread.cpp : 438 : virtual void CBasicThread::run() ] Thread ( 1 FSEventListener ) setting running flag ... [ CBasicThread(0x2101c44) ]
25.02.10 13:27:34:780 [Debug] [ 1 : FSEventListener ] [ CBasicThread.cpp : 443 : virtual void CBasicThread::run() ]
25.02.10 13:27:34:780 [Debug] [ 1 : FSEventListener ] [ CBasicThread.cpp : 445 : virtual void CBasicThread::run() ] eRunning 2
25.02.10 13:27:34:780 [Debug] [ 1 : FSEventListener ] [ CFSEventListenerThread.cpp : 24 : virtual int CFSEventListenerThread::runMethod() ] entering runMethod() ...
25.02.10 13:27:34:780 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1047 : listen ] listening ...
25.02.10 13:27:34:781 [Critical] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1092 : listen ] ioctl FSEVENTS_CLONE failed.
25.02.10 13:27:34:781 [Debug] [ 1 : FSEventListener ] [ CFSEventListenerThread.cpp : 27 : virtual int CFSEventListenerThread::runMethod() ] leaving runMethod() ...
25.02.10 13:27:34:781 [Debug] [ 1 : FSEventListener ] [ CBasicThread.cpp : 511 : virtual void CBasicThread::run() ] before clear callstack
25.02.10 13:27:34:781 [Debug] [ 1 : FSEventListener ] [ CBasicThread.cpp : 514 : virtual void CBasicThread::run() ] after clear callstack

MainThread_log.txt:
.10 13:27:34:651 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 187 : onFSEventListenerThreadFinished ]
25.02.10 13:27:34:651 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 103 : void CBasicThread::exitThread(int, long unsigned int, bool) ] Thread ( 1 FSEventListener ) setting finished flag ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:651 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 106 : void CBasicThread::exitThread(int, long unsigned int, bool) ]
25.02.10 13:27:34:651 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 108 : void CBasicThread::exitThread(int, long unsigned int, bool) ]
25.02.10 13:27:34:651 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 208 : startListener ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 211 : startListener ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 54 : bool CBasicThread::startThread(QObject*, QThread::Priority) ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 56 : bool CBasicThread::startThread(QObject*, QThread::Priority) ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 58 : bool CBasicThread::startThread(QObject*, QThread::Priority) ] Thread ( 1 FSEventListener ) starting ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 70 : bool CBasicThread::startThread(QObject*, QThread::Priority) ] eStartingUp
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 73 : bool CBasicThread::startThread(QObject*, QThread::Priority) ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 75 : bool CBasicThread::startThread(QObject*, QThread::Priority) ] Thread ( 1 FSEventListener ) starting up ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 666 : void CBasicThread::onStart() ] Thread ( 1 FSEventListener ) setting running flag ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 669 : void CBasicThread::onStart() ] eRunning
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 671 : void CBasicThread::onStart() ]
25.02.10 13:27:34:652 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 182 : onFSEventListenerThreadStarted ]
25.02.10 13:27:34:659 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 652 : void CBasicThread::onFinish() ] Thread ( 1 FSEventListener ) setting finished flag ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:659 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 656 : void CBasicThread::onFinish() ]
25.02.10 13:27:34:659 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 658 : void CBasicThread::onFinish() ]

This over and over and then at the end this:
25.02.10 13:27:34:718 [Critical] [ -1 : MainThread ] [ CChannel.cpp : 251 : onError ] [ChannelID: 1 ] Socket Error: "QLocalSocket: Remote closed"
25.02.10 13:27:34:718 [Debug] [ -1 : MainThread ] [ AChannelPeer.cpp : 161 : onChannelError ] [ChannelID: 1 ] "QLocalSocket: Remote closed" 1
25.02.10 13:27:34:746 [Debug] [ -1 : MainThread ] [ AChannelPeer.cpp : 274 : finalizeChannel ] [ChannelID: 1 ] finalize
25.02.10 13:27:34:746 [Critical] [ -1 : MainThread ] [ CSocketBase.cpp : 223 : void CSocketBase::abort() ] invalid
25.02.10 13:27:34:746 [Debug] [ -1 : MainThread ] [ CFSNotificationProtocolHandler.cpp : 45 : virtual bool ASignalHandler::finalize() ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 20 : finalize ] [ChannelName: "controlCommands" ] finalize
25.02.10 13:27:34:760 [Critical] [ -1 : MainThread ] [ CChannel.cpp : 251 : onError ] [ChannelID: 2 ] Socket Error: "QLocalSocket: Remote closed"
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ AChannelPeer.cpp : 161 : onChannelError ] [ChannelID: 2 ] "QLocalSocket: Remote closed" 1
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ AChannelPeer.cpp : 274 : finalizeChannel ] [ChannelID: 2 ] finalize
25.02.10 13:27:34:760 [Critical] [ -1 : MainThread ] [ CSocketBase.cpp : 223 : void CSocketBase::abort() ] invalid
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 221 : stopListener ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CFSNotificationProtocolHandler.cpp : 166 : virtual bool CFSNotificationProtocolHandler::finalize() ] [ChannelName: "notifications" ] unregister, result: true
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CFSNotificationProtocolHandler.cpp : 45 : virtual bool ASignalHandler::finalize() ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 20 : finalize ] [ChannelName: "notifications" ] finalize
25.02.10 13:27:34:760 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 187 : onFSEventListenerThreadFinished ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 103 : void CBasicThread::exitThread(int, long unsigned int, bool) ] Thread ( 1 FSEventListener ) setting finished flag ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 106 : void CBasicThread::exitThread(int, long unsigned int, bool) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 108 : void CBasicThread::exitThread(int, long unsigned int, bool) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 208 : startListener ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 211 : startListener ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 54 : bool CBasicThread::startThread(QObject*, QThread::Priority) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 56 : bool CBasicThread::startThread(QObject*, QThread::Priority) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 58 : bool CBasicThread::startThread(QObject*, QThread::Priority) ] Thread ( 1 FSEventListener ) starting ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 70 : bool CBasicThread::startThread(QObject*, QThread::Priority) ] eStartingUp
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 73 : bool CBasicThread::startThread(QObject*, QThread::Priority) ]
25.02.10 13:27:34:761 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 75 : bool CBasicThread::startThread(QObject*, QThread::Priority) ] Thread ( 1 FSEventListener ) starting up ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:780 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 666 : void CBasicThread::onStart() ] Thread ( 1 FSEventListener ) setting running flag ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:780 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 669 : void CBasicThread::onStart() ] eRunning
25.02.10 13:27:34:780 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 671 : void CBasicThread::onStart() ]
25.02.10 13:27:34:780 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 182 : onFSEventListenerThreadStarted ]
25.02.10 13:27:34:780 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 652 : void CBasicThread::onFinish() ] Thread ( 1 FSEventListener ) setting finished flag ... [ QThread(0x5030f0) ]
25.02.10 13:27:34:780 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 656 : void CBasicThread::onFinish() ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CBasicThread.cpp : 658 : void CBasicThread::onFinish() ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ AChannelPeer.cpp : 239 : onDeleteChannel ] [ChannelID: 1 ] delete
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CProtocolHandler.cpp : 177 : clear ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ AChannelPeer.cpp : 239 : onDeleteChannel ] [ChannelID: 2 ] delete
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CChannelServer.cpp : 111 : virtual void CChannelServer::allChannelsDeleted() ] [ChannelID: 1 ] all clients disconnected
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ CFSEventsDeamon.cpp : 446 : onTeamDriveDisconnected ]
25.02.10 13:27:34:781 [Debug] [ -1 : MainThread ] [ main.cpp : 199 : int main(int, char**) ] finished with exitCode: 0
systemverwalter
 
Posts: 24
Joined: 02 Mar 2010, 11:27

Re: Log file growing huge within hours

Postby Florian Grothe » 02 Mar 2010, 16:24

Hi systemverwalter,

it looks a bit like a problem we encountered on the some Mac 64Bit Versions due to the change of a system message format. In Order to remedy this, in case you're running 64Bit platforms I would suggest to try our new Beta version of TeamDrive, where this problem is solved.

If the problem persists, please send a whole set of logfiles and backuplogs to our Support with a reference to this thread

download new versions here

Florian
Florian Grothe
TeamDrive Team Member
 
Posts: 46
Joined: 12 Jan 2010, 12:34

Re: Log file growing huge within hours

Postby systemverwalter » 04 Mar 2010, 10:42

Hi Florian,

actually those were two problems in one. It can always occur that a log file grows, however a protection is needed that it will not fill up the drive. THAT would be very important for an App running on a server (where you may not pay attention to your drive filling up).
Please
- stop logging after one GB
- ask the user what to do with the options
- stop logging and sending you a automatic report
- delete file and continue logging
- continue logging till next GB

Noone ever reads the full GB of log so there is no need to have it ;-)

Aside from that thank you for the update!

All the best
Christoph
systemverwalter
 
Posts: 24
Joined: 02 Mar 2010, 11:27

Re: Log file growing huge within hours

Postby systemverwalter » 04 Mar 2010, 13:29

FSEventListener_log is still growing pretty fast (about 1 MB per minute, but still something that you don't want to have running day and night).

Looking closer it seems like the app is writing down every file change including TimeMachine backups?

It mostly looks something like this:
04.03.10 10:01:17:717 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1158 : listen ] received bytes: 862
04.03.10 10:01:17:717 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1189 : listen ] EventType: FSE_CREATE_FILE
04.03.10 10:01:17:717 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1189 : listen ] EventType: FSE_CONTENT_MODIFIED
04.03.10 10:01:17:718 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1189 : listen ] EventType: FSE_DELETE
04.03.10 10:01:17:718 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1189 : listen ] EventType: FSE_CREATE_FILE
04.03.10 10:01:17:718 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1189 : listen ] EventType: FSE_CONTENT_MODIFIED
04.03.10 10:01:17:718 [Debug] [ 1 : FSEventListener ] [ CFSEventListener.cpp : 1189 : listen ] EventType: FSE_RENAME
systemverwalter
 
Posts: 24
Joined: 02 Mar 2010, 11:27

Re: Log file growing huge within hours

Postby Florian Grothe » 05 Mar 2010, 12:47

Hi Christoph,
the FSEventListener is listening to all the event on the file system, since this is a new release we are logging more than we normally would. We will reduce the amount of events to log once the release is on the market for a while.

But anyhow, you are absolutely right that logs should not grow until all space is exhausted!
Right now, logs are reset on TDStartup. Which worked well for most users. Obviously it does not work for all users. Therefore we will gladly take your suggestions into account:
  • stop logging after one GB
  • ask the user what to do with the options
  • stop logging and sending you a automatic report
  • delete file and continue logging
  • continue logging till next GB


So thanks for the input.

BG
Florian
Florian Grothe
TeamDrive Team Member
 
Posts: 46
Joined: 12 Jan 2010, 12:34


Return to Mac OS X

Who is online

Users browsing this forum: No registered users and 11 guests

cron