The law firm I used suggested otherwise:
"PLEASE NOTE, ONCE THE TRAVEL AUTHORIZATION IS UTILIZED, YOUR STATUS THEN BECOMES A “ADJUSTMENT APPLICANT” AND THE WORK AUTHORIZATION MUST BE UTILIZED FOR ALL EMPLOYMENT, INCLUDING YOUR CURRENT EMPLOYMENT. I WOULD ADVISE TO NOT USE THE TRAVEL AUTHORIZATION DOCUMENT AS LONG AS YOUR H1B AND H4 STATUS ARE VALID."