"She was saying craziness about the rapture not being real, and everyone going to hell," one witness, who was not identified, told KGTV.
>> Read more trending news
Conkey then pointed the gun at the baby, witnesses told KABC. That's when churchgoers took action, disarming and tackling her, the station reported.
"We got the baby away from her," said worshipper David Michael Miller. "A few minutes after that, the cops came in. She was trying to run away or something, so a cop tackled her through a row of chairs."
Police said they arrested Conkey and determined that her handgun wasn't loaded.
"Due to the statements made by the suspect, a sweep of the facility along with the suspect's vehicle was conducted by a bomb detection canine," police said in a news release. "Nothing was found, and the area was determined to be safe."
The baby and Conkey's 5-year-old daughter "have been taken into protective custody and will be evaluated by Child Welfare Services," police said.
Read more here.