6

Dual-Loop Evolution and Adaptive Mechanisms

AI999第5课:方法演化:从优化解到优化算法本身
00:00

Dual-Loop Evolutiondecouples “solving specific tasks” and “improving solution methods” into two interacting evolutionary loops:the inner looptargets task solving and produces runtime performance,the outer loopevolves the inner algorithm's configurations and strategies based on that performance, forming an adaptive algorithm-improvement mechanism. It is not a simple chaining of two algorithms; rather, it adds an evolvable meta-level control layer above the task-solving layer, shifting the system from “manually setting algorithms” to “algorithms automatically adapting to tasks.”

Dual-Loop Evolution: A Feedback Loop Between Task Solving and Method EvolutionInner Loop: Task-Solving LayerExecutes many concrete tasks in parallel, producing candidate solutions and runtime performanceTask T1Task T2Task T3Task TnOutput: candidate solutions · objective value f · runtime performanceResource time · convergence steps · success rateServes as the basis for evaluating outer-loop fitnessTensorized batch executionMutation, evaluation, and state updates enter the computation graphInner-loop role: solve the problemOutput solutions and runtime performance for outer-loop evaluationOuter Loop: Method-Evolution LayerDoes not solve the original task directly; instead evolves inner-loop configurations and strategiesAdaptive mechanism: continuously adjusts inner-loop strategies as tasks and environments changeUsing evolution to improve evolutionEvaluateSelectMutateUpdateOuter-loop role: improve the problem-solving methodAdaptive: continuously adjusts inner-loop strategies as tasks and environments changeInner-loop runtime performanceAggregated into a fitness signalReverse updateInner-loop configurations and strategiesGPU parallelism: run inner-loop tasks in batches, giving the outer loop richer statistical feedback and reducing search wait timeLearning objective: understand the collaboration between inner-loop solving and outer-loop strategy optimization

Division of responsibilities between the inner and outer loops

  • Inner-loop role: solves real tasks and generates candidate solutions, objective values, and runtime performance data. It is responsible for “solving the problem.”
  • Outer-loop role: does not solve the original task directly; instead evolves the inner algorithm's configurations, strategies, and parameters. It is responsible for “improving the problem-solving method.”
  • Feedback loop: the evaluation results of inner-loop tasks are aggregated into an outer-loop fitness signal, used to select, mutate, and update better inner-loop configurations.
  • Adaptive mechanism: the outer loop continuously adjusts inner-loop strategies in response to changes in tasks and environments.
  • Parallel support: the GPU can run many inner-loop tasks in parallel, providing richer statistical feedback for outer-loop evolution and reducing search wait time.

MetaDE: Using Evolution to Improve Evolution

Take MetaDE as an example: the inner DE handles concrete optimization tasks, while the outer evolutionary algorithm selects and adjusts DE's configurations and strategies based on inner-loop runtime performance. The results of many inner-loop tasks in turn guide outer-loop configuration selection, forming a dual-loop closed cycle: “using evolution to improve evolution.”

Key distinction
The inner loop outputs “solutions”; the outer loop outputs “better methods for producing solutions.” Outer-loop fitness is not the optimal value of the original task itself, but an evaluation of how an inner-loop configuration performs across a batch of tasks.

Learning objectives

Master the collaborative relationship between inner-loop task solving and outer-loop strategy optimization, understand that method evolution adds an evolvable meta-level control layer above the inner loop, and be able to explain how GPU parallelism provides the outer loop with more reliable statistical feedback.