From Instructions to Action