It is the responsibility of the project manager to organise priorities for the team members.
You should provide direction on what is the most important task.
You should settle conflicts between activities.
Provide things like the network diagram and critical path of the project to clarify to team members what work is the most important.
The PM should also give their team direction on the requirements for time, cost, scope, and quality.