Is it possible for you or your husband to change your hours or work on alternate days? Can one of you work part-time or find a position that allows more flexibility? Can either of you work from home?
You and your family are the only ones who can decide the working vs. homeschooling issue. If your family decides to give homeschooling a try, then everyone must be willing to adjust their lives accordingly. Families can save money by renting movies instead of going to the theater, not eating out, buying items used at yard sales, taking modest vacations, driving older-model or less expensive cars, etc. One homeschooling mom told me when she sat down and figured out how much she spent on clothes for work, lunch, travel, and other expenses (including take-out food for dinner), her actual take-home pay, adjusted for taxes, was not very much. With a little tightening up, and her working at home part-time, she was able to homeschool and still live comfortably.
Have a family meeting and discuss all the options. Whatever you decide as a family will be the right choice for you. What other people think you should do must not influence your decision. Good luck.