sched: Fix load avg vs. cpu-hotplug
authorPeter Zijlstra <peterz@infradead.org>
Wed, 5 Sep 2012 22:03:50 +0000 (00:03 +0200)
committerIngo Molnar <mingo@kernel.org>
Thu, 13 Sep 2012 14:52:05 +0000 (16:52 +0200)
Commit f319da0c68 ("sched: Fix load avg vs cpu-hotplug") was an
incomplete fix:

In particular, the problem is that at the point it calls
calc_load_migrate() nr_running := 1 (the stopper thread), so move the
call to CPU_DEAD where we're sure that nr_running := 0.

Also note that we can call calc_load_migrate() without serialization, we
know the state of rq is stable since its cpu is dead, and we modify the
global state using appropriate atomic ops.

Suggested-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
Link: http://lkml.kernel.org/r/1346882630.2600.59.camel@twins
Signed-off-by: Ingo Molnar <mingo@kernel.org>
kernel/sched/core.c

index 8b51b2d9b1fda1bfebf50f9ebde60d6c831cbb42..ba144b121f3d3ea7b917773d4093a98cb3506e83 100644 (file)
@@ -5048,7 +5048,9 @@ migration_call(struct notifier_block *nfb, unsigned long action, void *hcpu)
                migrate_tasks(cpu);
                BUG_ON(rq->nr_running != 1); /* the migration thread */
                raw_spin_unlock_irqrestore(&rq->lock, flags);
+               break;
 
+       case CPU_DEAD:
                calc_load_migrate(rq);
                break;
 #endif