your feelings are totally valid but i just wanna explain from the perspective of someone w/ chronic illness

going to the doctor can be really frustrating bc doctors will often ignore symptoms or tell you they're nbd even if they are. it gets to the point where going to the doctor at all becomes something you don't want to do, because you know they'll just blow it off. it's really really difficult for someone with chronic illness to find a doctor who isn't crap. a lot of doctors start to think you're drug seeking, or a hypochondriac, or a bunch of other things. it starts to twist your perception on what's an emergency and what's not and you start to figure you should just wait symptoms out and only go to the doctor if they don't go away, even if it's a severe symptom. because doctors sometimes do blow off even severe symptoms. it's not right, but a LOT of doctors treat people with chronic illness horribly

that said you have every right to worry and be honest about your feelings, and if it's a stress on you you have every right to ask them to not put that load on you