I would not worry at all doing this.
Assuming the filter was replaced last oil change and the oil was still in good condition for its age on this oil change this should be fine.
Typically it is safe to replace an oil filter every second oil change, unless you have reason to believe it could be clogged (i.e. oil change very late), or don't know when it was last replaced.
If you are going to be doing a filter change next week, (seems like you already did the oil change), it should be fine, if re-using the oil from this oil change, make sure there are NO metal particles in it, otherwise just replace it with fresh oil.
Next time in this situation, it might be worth putting cheaper oil (that meats the standards required by engine of course) then when doing the filter change, put a really nice fully-synthetic brand in.
Especially if you are racing it often you want higher quality oil.