India's Home Secretary V.K. Duggal says it is too early to say who is responsible for the attack but the pattern of the Varanasi blasts was similar to the pre-Diwali serial explosions in Delhi last year, he added.

"As of now I cannot say which was the outfit responsible for this ghastly and absolutely condemnable action," he said.  "But certainly since one of the places attacked was a temple, so it has the potential of creating suspicion and creating tensions amongst different the communities."

Duggal said all state governments had been put on alert so that tensions between India's majority Hindus and minority Muslims do not flare into violence in the wake of the bombings. Security has also been increased at large temples.

Indian Prime Minister Manmohan Singh has also appealed for calm.

Local media report that police have defused at least six other bombs across Varanasi.

In the past, attacks at holy sites in India have led to clashes between India's Hindus and minority Muslims.

India is home to a variety of separatist groups and insurgencies, many of which would have a motive for the attack. 

Three explosions rocked the capital New Delhi in October, killing more than 60. Officials blamed the attack on Islamic extremists fighting to force India to leave the disputed region of Kashmir.  The predominantly Muslim region is claimed by both India and neighboring Pakistan.

Varanasi's Sankat Mochan temple, where one of the blasts occurred is located along the River Ganges, and is one of India's oldest Hindu holy sites.  Officials say neither idols inside the temple nor the temple structure itself were damaged by the blast.