You should speak with your doctor if things continue for longer than a day or if you feel things are getting worse instead of improving. Most people who have reactions to food supplements only note minor issues, but there are some people who have severe problems and they need to be treated accordingly. Ignoring it and hoping it goes away will only make it harder to treat once you actually seek out medical attention.
While supplements are generally useful, they do have side effects that people should be aware of. Reading labels and being careful about drug interactions can reduce your chances of having any issues. Dealing with a problem proactively instead of waiting until it is a greater risk is a good idea, which is why you should follow the advice here.