A third explosion was later reported at a church in Batticaloa, a major city in Sri Lanka's Eastern Province.
Reports also confirm that tourists have been injured at explosions in Colombo's Shangri La, Cinnamon Grand and Kingsbury hotels.
Dozens of people have been confirmed dead, after a series of bomb blasts during Easter Mass in targetted several churches and worldwide hotels across the island.
Debris is seen at St Anthony's church after explosions hit churches and hotels in Colombo, Sri Lanka, on Sunday, in this still image obtained from video.
An official at the Batticaloa hospital told AFP that more than 300 people had been admitted with injuries following the blast there.
There were no immediate claims of responsibility for the attacks in a country which was at war for decades with Tamil separatists until 2009 during which bomb blasts in the capital were common.
Explosions at three churches and three luxury hotels across Sri Lanka killed over 130 people.
Sri Lankan security personnel stand next to an ambulance outside St. Anthony´s Shrine in Kochchikade in Colombo on April 21, 2019 following a blast at the church.
"Our people are engaged in evacuating the casualties", the source said.
Sri Lankan security officials said they were investigating.
Some reporters of the Sri Lankan media have stated on Twitter that at least 25 people have been killed in the explosions and over 150 people have been injured and have been taken to the hospital. He said,"I strongly condemn the cowardly attacks on our people today". I call upon all Sri Lankans during this tragic time to remain united and strong.
Earlier, Wickremesinghe tweeted that "the government is taking immediate steps to contain the situation". "Hopefully saved many lives", added de Silva.
"Horrible scenes. I saw many body parts strewn all over". He further assured that rescue operations are underway and has advised people to stay calm and indoors.
Hours after multiple bomb blasts rocked Sri Lanka, External Affairs Minister Sushma Swaraj Sunday said the government is keeping a close watch on the situation and was in touch with the Indian High Commissioner in Colombo.
In its 2018 report on Sri Lanka's human rights, the U.S. State Department noted that some Christian groups and churches reported they had been pressured to end worship meetings after authorities classified them as "unauthorized gatherings".