There are many workers and daily wage earners who don’t have the privilege to take the day off — on May 1