Yes, you need to be on the Questions screen within the Assignment Builder. 

To access, navigate to the assignment, click Edit, select Edit Questions.

To make the assignment ungraded, set points to zero (0). Save Changes.