Re: Test for CFS Bandwidth Control V6

From: Hidetoshi Seto
Date: Mon May 23 2011 - 20:55:31 EST


Hi Paul and Xiao,

Please check/test a fix at the foot of this mail.

(2011/05/20 11:12), Xiao Guangrong wrote:
> Hi Paul,
>
> I'm so sorry for sending this mail in the new thread, since i didn't
> receive your V6 patchset from LKML.
>
> It seams the patchset can not be applied, since it's conflict between
> patch 3 and patch 5:
>
> ========Quote========
(snip)
> ========End quote========

Maybe I've fixed it by hand, or git-am is so wonderful.

I believe Paul will do it right for next time.

>
> I downloaded the patchset from Internet, i missed the newer version?
>
> I have done some test after fixed the conflict by handle, below test can cause
> box crash:
>
> ========Quoteãcpu_hotlpug.sh ========
(snip)
> ======== End quoteãcpu_hotlpug.sh ========
>
> Sorry to disturb you if the bug is know.
>
> Thanks!

Thank you for reporting it, Xiao!

I confirmed that running your test cause hung-up on my box.
And after some investigation, I found that this is an infinite loop
in migrate_task() due to miscalculation of rq->nr_running; when a
task is queued to throttled entity the nr_running is incremented at
the queuing and also the unthrottling.

I made a fix for this bug and it seems works well for me.
Could you try this patch and give us your feedback, Xiao?

Thanks,
H.Seto

---
kernel/sched_fair.c | 28 +++++++++++++---------------
1 files changed, 13 insertions(+), 15 deletions(-)

diff --git a/kernel/sched_fair.c b/kernel/sched_fair.c
index 3936393..544072f 100644
--- a/kernel/sched_fair.c
+++ b/kernel/sched_fair.c
@@ -1537,7 +1537,7 @@ static void unthrottle_cfs_rq(struct cfs_rq *cfs_rq)
walk_tg_tree_from(cfs_rq->tg, tg_unthrottle_down, tg_nop,
(void *)&udd);

- if (!cfs_rq->load.weight)
+ if (!cfs_rq->h_nr_running)
return;

task_delta = cfs_rq->h_nr_running;
@@ -1843,10 +1843,9 @@ enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags)
cfs_rq->h_nr_running++;

/* end evaluation on throttled cfs_rq */
- if (cfs_rq_throttled(cfs_rq)) {
- se = NULL;
- break;
- }
+ if (cfs_rq_throttled(cfs_rq))
+ goto done;
+
flags = ENQUEUE_WAKEUP;
}

@@ -1855,14 +1854,14 @@ enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags)
cfs_rq->h_nr_running++;

if (cfs_rq_throttled(cfs_rq))
- break;
+ goto done;

update_cfs_load(cfs_rq, 0);
update_cfs_shares(cfs_rq);
}

- if (!se)
- inc_nr_running(rq);
+ inc_nr_running(rq);
+done:
hrtick_update(rq);
}

@@ -1885,10 +1884,9 @@ static void dequeue_task_fair(struct rq *rq, struct task_struct *p, int flags)
cfs_rq->h_nr_running--;

/* end evaluation on throttled cfs_rq */
- if (cfs_rq_throttled(cfs_rq)) {
- se = NULL;
- break;
- }
+ if (cfs_rq_throttled(cfs_rq))
+ goto done;
+
/* Don't dequeue parent if it has other entities besides us */
if (cfs_rq->load.weight) {
/* Avoid double update below. */
@@ -1910,14 +1908,14 @@ static void dequeue_task_fair(struct rq *rq, struct task_struct *p, int flags)
cfs_rq->h_nr_running--;

if (cfs_rq_throttled(cfs_rq))
- break;
+ goto done;

update_cfs_load(cfs_rq, 0);
update_cfs_shares(cfs_rq);
}

- if (!se)
- dec_nr_running(rq);
+ dec_nr_running(rq);
+done:
hrtick_update(rq);
}

--
1.7.4.4


--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/