On another occasion, the Buddha said: «Brothers, when I speak to you, do not accept my words blindly merely out of love and respect for me. But test it, test it, test it as a goldsmith tests gold by cutting it, subjecting it to fire, and striking it with a hammer to determine whether it is genuine or counterfeit. Take my words to heart and follow them only if you find them reasonable». This is also the Buddha's way. This is how the Buddha encouraged everyone to think through ideas and concepts by themselves, with their own minds.
Some religions warn against this and ask you simply to believe what they say and teach. Otherwise, their god will send them to hell. The Buddha never uttered curses and never promised punishment to those who did not believe in him.
As for worship rituals, they have no place at all in the Buddha's teachings. You may ask why Buddhists lay flowers in front of the Buddha's image. However, by doing so, they are only showing their gratitude to the greatest Guru for his selfless, lifelong service to all mankind, for his teachings, and for opening the righteous path to the whole world. This is by no means a ritual.
It is not so important whether you take refuge in the Buddha or not. What is important is to lead a good life by following the path he pointed out. The Buddha had one devoted and respectful disciple. One day, sitting down next to him, he looked directly at the Buddha, who was at that moment in his holiest and most beautiful form. The Buddha understood the disciple's condition and said: «What is the use of looking at this body, a mass of flesh and bones? ... Get out of here and look at the Dhamma» (i.e., practice the virtues, follow the law of truth).
Whether you take refuge or not is not as important as living a good life, pure in deed, word, and thought. You are a true follower of the Buddha if you try to lead a pure life.
Venerable Balangoda Anandamaitreya