Cam Cameron has been removed as offensive coordinator, according to multiple reports.
The Baltimore Sun is reporting that Quarterbacks Coach Jim Caldwell will step into the position.
The team has not made an official announcement.
Caldwell mentored quarterback Peyton Manning in Indianapolis and was the Colts' head coach for three years. However, he has never been an offensive play caller during his 12 NFL seasons or in college.
Cameron had been the Ravens' offensive coordinator since 2008, the start of the Head Coach John Harbaugh era.
During that time, the highest the Ravens offense has ranked in terms of yards per game is 13th in 2009, when Baltimore posted 351.2 yards per game.
Baltimore's offense has added weapons over the past several years, but has not made much overall improvement. It currently ranks 18th in the league with 344.4 yards per game. The Ravens are in the top 10 in points per game this year.
Cameron has largely been in charge of overseeing quarterback Joe Flacco's development. He was the offensive coordinator and quarterbacks coach last year before Caldwell was brought in this season to work with Flacco.
But Flacco also hasn't seen a dramatic improvement in his statistics during his five seasons, and is in the final year of his rookie contract with an extension expected.
The Ravens, pundits and fans had high expectations for Flacco entering the year after he looked strong in training camp and the preseason, and in Week 1 against Cincinnati.
After Sunday's 182-passing yard performance with three touchdowns, one interception and one fumble, Flacco is on pace for 3,963 yards, 22 touchdowns and 11 interceptions. That's a career high in passing yards, but short of his 2010 touchdowns (25) and about on pace in interceptions.
Flacco told The Baltimore Sun last week that he's "frustrated" with the offense's lack of improvement this year. Flacco said it "comes back to the quarterback," but he also said it's a little frustrating that the Ravens aren't using more no-huddle.
Cameron has been under fire in Baltimore for the past few years, criticized by fans and media for not giving running back Ray Rice the ball enough and for his play calling.
Caldwell's first game will be against his former quarterback and the Denver Broncos this Sunday at M&T Bank Stadium.
The laid-back Caldwell and Flacco seem to have built a good relationship during their time together in Baltimore, and the coach speaks highly of his quarterback.
"We're getting a feel for one another," Caldwell said in June. "We get along and those kinds of things. It's a great working relationship at this point."