[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: ZFS & Bittorent -> Hang?
- To: "Claus Guttesen" <kometen_(_at_)_gmail_(_dot_)_com>
- Subject: Re: ZFS & Bittorent -> Hang?
- From: "James Snyder" <jbsnyder_(_at_)_gmail_(_dot_)_com>
- Date: Tue, 15 Apr 2008 12:05:41 -0500
- Cc: freebsd-stable_(_at_)_freebsd_(_dot_)_org
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=262pwJ8mg7kTSI+uBEThLkqymePf7VM5t1ItiHdyQ/w=; b=ZwD+5kReiJiokkdnnFjUz/XXBRg5e50AWB6KlV37R8B7sI3DqY0on+xOF76c10pPiRUIuMGb7KWrMG3WH8Rf+RFdKS7MW6Ibox5tOo39Si1gK8eN4Q1XprMgCMx3Y0IpmrxMzal+B3JgKrCFbMfUKqPyMjzuG9BQti3W4pcnAMA=
- Reply-to: jbsnyder_(_at_)_gmail_(_dot_)_com
Thanks for the followup. I have not yet gotten a reliable test case
to reproduce the problem. I've done a number of tests with the zil
and/or prefetch on with no hangs. I will be collecting some more data
later this week.
If anyone knows a source of consistently slow but large torrents (I
suppose I could artificially limit bandwidth, or connection states at
my router which is running pfSense), that might help for testing. The
process that triggered things before was about a gigabyte or two but
took around 12 hours to complete.
Here's the overall group of variables I'm experimenting with.
Stock Kernel vs Recompiled Kerel w/ ULE (stock sources otherwise)
ZIL on and off
prefetch on and off
Should I add or remove anything? I have no idea if ULE may or may not
play a role here, but my original failing condition had the zil off,
prefetch on, ule for the scheduler.
I also had:
vm.kmem_size_max="1073741824" (loader.conf)
vm.kmem_size="1073741824" (loader.conf)
Any recommendations on what to leave running to record what zfs is
getting hung on, beside watching states? Since I can fire up things
prior to the hang, and they'll keep running if disk isn't hit, I could
leave some diagnostics running to display what's blowing up.
Thanks!
On Tue, Apr 15, 2008 at 4:44 AM, Claus Guttesen <kometen_(_at_)_gmail_(_dot_)_com> wrote:
> > > http://wiki.freebsd.org/ZFSKnownProblems
> > >
> > > This looks like #1.
> > >
> >
> > Hmm.. I don't think there's a large amount of transfer between UFS & ZFS,
> > unless the client is using /tmp a lot, it should all be on ZFS.
> >
> > I noted #4 as well, and therefore tried disabling prefetch. I can't seem to
> > get it to hang now. I queued up a bunch of different torrents (full freebsd
> > 7 amd64 & i386, some other random things), and they all completed without
> > leading to me being locked out or any processes waiting on zfs.
> >
> > I'll try some testing this weekend to see if I can reproduce the lock-up
> > again by re-enabling prefetch. Perhaps we can confirm that issue? Should I
> > bother with trying to run CURRENT or should any testing I do be done with
> > STABLE. I don't see any indication that there might be experimental patches
> > for dealing with this or related issues.
>
> Were you able to reproduce the lock-up by re-enabling prefetch?
>
> --
> regards
> Claus
>
> When lenity and cruelty play for a kingdom,
> the gentlest gamester is the soonest winner.
>
> Shakespeare
>
--
James Snyder
Biomedical Engineering
Northwestern University
jbsnyder_(_at_)_gmail_(_dot_)_com
_______________________________________________
freebsd-stable_(_at_)_freebsd_(_dot_)_org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscribe_(_at_)_freebsd_(_dot_)_org"
Visit your host, monkey.org