Problem solving in complex domains often involves multiple agents, dynamic environments, and the need for learning from feedback and previous experience. In order for robots to assist humans in tasks such as disaster search and rescue or national security defense, they must be able to collaborate autonomously (without the aid of humans). Soccer is an ideal test domain for developing new theories of collaboration and cooperation. We must be able to design and create new theories of robot teamwork to make progress in this area.