In some places you can get a home internet line that runs through the mobile phone data network, and they tend to be more reliable than cabled connections, they can get even better if they use a modem data plan and not explicitly a home bulk plan. It really hinges on how much data you use and what plans are available where you are. Of course if you do it this way you won’t have a private IPV4, but if your ISP allows IPV6, that should be unique and directly accessible no matter what.
As the other poster mentioned there are routers that have a SIM connection as backup, and now they’re being offered with a SIM and automatic fail-over as part of some fiber to the home plans.
I can tell you from experience I have a Samsung T5 (500GB) that has over 95TB of writes over 5+ years to it and it’s only used up 17% of its spare blocks. The T7 which is the newer model is like $40, I’d just get one of those. They’re very reliable, I’ve bought a few and none of them have failed. The larger drives have more spare blocks and are even more resistant to writes.
Personally I would recommend a portable SSD, over a HDD as I’ve had several HDDs fail but never lost an SSD, BackBlaze backs this up with their total drive failure statistics being 2.5% for HDDs and under 0.5% for SSDs. Your real danger will be that a portable drive is guaranteed to get jostled and an SSD is far more resilient to that.