Paul Brown, Jim Brown and Modell. Browns story of the decade, 1956-65

EDITOR’S NOTE: We are observing the Browns’ 80th birthday with articles that define the franchise, one decade at a time. This is the “story of the decade” covering the period 1956-65.

Everyone well familiar with Cleveland Browns history knows about Art Modell firing Paul Brown.

Less known is the story of Jim Brown firing Modell.

Head coach Paul Brown brought ball carrier Jim Brown to Cleveland with the No. 6 overall pick of the 1957 NFL Draft.

The draft was weirdly rammed into the middle of the season, actually taking place on No. 26, 1956, a day after the Browns fell to Washington at home.

The loss sank them to 3-6, and the fans weren’t buying it after 10 straight years of league championship games with Otto Graham, now retired, at quarterback. The Municipal Stadium crowd was 22,878.

Jim Brown wasn’t yet finished at Syracuse, which took a 7-1 record to Dallas for the Jan. 1, 1957 Cotton Bowl. Wearing No. 44, Brown ran for 132 yards and three touchdowns. He also kicked extra points, one of which was blocked − the difference in a 28-27 defeat.

Browns running back Jim Brown follows the blocking of guard Jim Ray Smith (64) as he is pursued by Baltimore Colts linebacker Bill Pellington (36) and Ordell Braase (81), Oct. 14, 1962, at Cleveland Stadium.

No. 44 was taken in Cleveland by running back Chet Hanulak, who was no superstar, but was paid the respect owed to a veteran. Hanulak was a Browns rookie in 1954 when he ran for a touchdown in a 56-10 rout of Detroit in the 1954 NFL Championship Game. He didn’t play in 1955 and 1956 because of an Air Force commitment.

Hanulak returned to the Browns in 1957, sharing the load with Jim Brown in the opener against the Giants. No. 44 ran 17 times for 16 yards. The rookie, wearing No. 32, ran 21 times for 89 yards.

Browns running back Jim Brown takes a handoff from quarterback Frank Ryan against Washington, Sept. 15, 1963, at Cleveland Stadium.

Brown wore No. 32 from then on.

To avoid confusion because of their shared surname, the rest of this story will refer to the coach, Paul Brown, and the runner, Jim Brown, as PB and No. 32.

The 1956 Browns finished at 5-7. Losing was hard on PB, who steered the team to an astounding 114-20-4 record from 1946-55.

Cleveland Browns head coach Paul Brown (center) stands on the sideline during a home game in November 1962.

PB returned to the championship game, with his new runner in 1957. The 1958 Browns had a chance to reach his 12th league finals in 13 years of existence, but lost the regular-season finale, forcing a playoff to determine the Eastern Conference champ. The Browns fell 10-0 to the Giants.

PB’s 1960 team came close to making the championship game, but a lead in the final seconds turned into a 31-29 loss to the Eagles. It was the difference in Philadelphia rather than Cleveland winning the Eastern Conference. The Eagles then beat the Packers in the title game.

The 1960 offense hummed behind quarterback Milt Plum, scoring a league-high 362 points. The runner-up Packers put up 332.

PB was 34 when he won a national championship at Ohio State in 1942. Art Modell, a New York City marketing man, was 35 when he bought the Browns in January of 1961.

During better days in July 1962, Cleveland Browns owner Art Modell (left) and head coach Paul Brown talk during a preseason workout at Hiram College.

The main Browns owners – David Jones, Ellis Ryan, Herb Evans, Bob Gries − wanted a new arrangement. Modell fronted a group that included an old New York beer maker, the Schaefer Brewing Company. The beer guys launched a Cleveland operation shortly after Modell’s group bought controlling interest. PB kept the 5% share he had held all along.

In Jim Brown’s 1989 book, “Out of Bounds,” he wrote, “For Art, an outsider, to have the audacity to even think about buying Paul Brown’s team was astonishing to the players. … Anyone with any kind of mind could see that Paul and Art would not co-exist for long.”

No. 32 gave the 1961 Browns a league-best 1,408 rushing yards, but a few close losses and an 8-5-1 record kept them out of the postseason.

Aug 25, 1961; Los Angeles, CA, USA; FILE PHOTO; Cleveland Browns head coach Paul Brown addresses his team in a huddle against the Los Ageles Rams at Los Angeles Memorial Coliseum during the 1961 season. Mandatory Credit: David Boss-USA TODAY Sports

PB saw a path to Ernie Davis, the 1961 Heisman Trophy winner, a big back from Syracuse.

PB already had No. 32 and Bobby Mitchell, a seventh-round draft steal in 1958 who became so good as a running back and later a wide receiver that he is in the Pro Football Hall of Fame.

PB sprang a blockbuster draft-day trade on Dec. 4, 1961. First, Washington used the No. 1 overall pick to take Ernie Davis. Then, PB sent Mitchell to Washington for the rights to Davis.

PB considered trading No. 32, but concluded he couldn’t get a fair return. He viewed Davis as a force who could take over if No. 32 couldn’t co-exist with him.

PB touched on the subject in his autobiography:

“Jim always had to be the man in the spotlight, but he often let it get the best of him. … Jim got very touchy when everyone referred to Bobby as the racehorse and Jim as the workhorse.”

It became apparent something wasn’t right with Davis as the 1962 season neared. In July, he was diagnosed with leukemia. On May 18, 1963, he died.

With Davis never playing a down and Mitchell gone to Washington, PB’s offense regressed. In Game 2 of the ’62 season, the Browns led Washington 16-10 late but lost on a 50-yard touchdown catch by, yes, Mitchell.

Washington Redskins flanker #49 Bobby Mitchell runs against the Cleveland Browns.

PB used two new quarterbacks, Jim Ninowski and Frank Ryan, having traded Plum to the Lions and lost Dawson to the American Football League. PB’s rookie No. 4 overall draft pick, Gary Collins, caught only 11 passes all year.

No. 32 said he loved playing for PB, for a while. He described a loss of trust in the offense in “Out of Bounds”:

“Paul started running me inside the tackles. Suddenly, we had no sweeps. I started thinking, woah, these guys are gonna kill me. They know where I’m coming.

“We finished the season 7-6-1. We felt we lost some games we didn’t need to lose. In December, several of the veterans decided things had gotten too strange. We designated several team leaders to represent our point of view. We felt we wanted to open up the offense. The guys on defense felt stilted, too.

“We planned to visit Paul at his home. Art Modell found out about the plan. He said, ‘You don’t have to do that. I have a solution.’

“I think Art manipulated us. If Art had come in and summarily fired Paul, the local response would be outrage. I think Art wanted to run the Browns for himself and waited for a fertile situation.”

Three weeks after the 1962 season, Modell summoned PB to his Municipal Stadium office and fired him. A stunned PB told Modell it was more than a matter of paying off his contract, which had eight years left at $82,500 a year.

From PB’s autobiography:

“The morning after I was fired, I found the contents of my desk, and the pictures of my family, in a cardboard box on my front porch. The message was very clear. Don’t come back to the office.”

After a few depressing months, PB wanted to move as far from Cleveland as he could get. He and his wife Katy sold their home in Shaker Heights, said very few goodbyes, and moved to a place on the Pacific Ocean north of San Diego.

Still under contract, not working any other football job, PB actually was assigned Browns duties. He was to keep an eye out for players the team might acquire, and recommend any improvements in the organization.

PB honored his lawyer’s instructions. He sent in reports, including a glowing one on an Ohio State prospect, Paul Warfield, but he never heard back from any of Modell’s people.

The 1963 team went 10-4, but missed the playoffs. The Cleveland Browns still looked a lot like Paul’s Browns.

The new head coach, Blanton Collier, worked with PB at the Great Lakes Navy base in World War II and went with him to the Browns for the start of the Cleveland dynasty.

Aug 22, 1965; Los Angeles, CA, USA; FILE PHOTO; Cleveland Browns head coach Blanton Collier on the sidelines against the Los Angeles Rams in a pre-season game at the Memorial Coliseum.

Defensive coordinator Howard Brinker and offensive assistant Fritz Heisler played for PB at Massillon and coached for him a number of years.

The 1964 Browns won the NFL championship with only a few players not acquired by PB.

The starters on offense were No. 32 at fullback, Ernie Green at halfback, Ryan at quarterback, Collins at flanker, Johnny Brewer at tight end, Dick Schafrath and Monte Clark at tackle, Gene Hickerson and John Wooten at guard, and John Morrow at center.

Only Warfield and Clark were not signed by PB.

Defensive starters who had been acquired by PB were ends Paul Wiggin and Bill Glass, tackle  Jim Kanicki, middle linebacker Vince Costello, outside linebackers Jim Houston and Galen Fiss, cornerback Bernie Parrish, and safety Ross Fichtner.

Kanicki was a rookie in 1963, but PB acquired him in the second-round of the 1963 draft, actually conducted on Dec. 3, 1962. The other starting safety was Cleveland Heights native Larry Benz, who went undrafted in 1963 but wound up making the team and basically replacing Don Fleming, a former PB draft pick who was electrocuted in June of 1963 while working an offseason construction job.

PB feared his life was over, literally, in 1964. He and Katy were traveling to the Olympic Games in Tokyo. A wing engine near their seats caught fire. PB alerted an attendant, who notified the captain, who soon tilted the flight angle to keep flames from spreading.

As PB put it, “Katy and I said our good byes. I told her I had a wonderful life with her.”

The plane was near enough to Tokyo to have a chance. A hairy landing and rescue saved a lot of lives.

PB and Katy made it to the Olympics. They saw Bob Hayes win gold in the 100-meter dash on Oct. 15. On Dec. 27, the Cleveland Browns whipped the Baltimore Colts 27-0 in the NFL finals.   

Dec 27, 1964; Cleveland, OH, USA; FILE PHOTO; Cleveland Browns quarterback Frank Ryan (13) is chased by Baltimore Colts linebacker Don Shinnick (66) during the 1964 NFL Championship game at Cleveland Stadium. The Browns defeated the Colts 27-0. Mandatory Credit: Malcolm Emmons-USA TODAY Sports

After a scoreless first half, Ryan and Collins connected on three post-pattern touchdowns. Going on 63 years later, it stands as the Browns’ last win in a league championship game.

Browns linebacker Vince Costello (50) intercepts a pass from Baltimore Colts quarterback Johnny Unitas during the 1964 NFL Championship Game at Cleveland Municipal Stadium, Dec. 27, 1964. The Browns won 27-0.

The 27-0 shutout featured an interception by Costello, “The Pride of Magnolia.” Jim Houston, from Massillon, added to the Stark County flavor.

No. 32 had a nice game, 27 runs for 114 yards, three catches for 37 yards.

He was at the top of his game in 1964, leading the NFL in rushing-receiving yards with 1,786. Next best was Green Bay’s Jim Taylor with 1,288.

It was more of the same in 1965. No. 32 led the league in yards from scrimmage with 1,872. Tim Brown of the Eagles was next with 1,543.

The Browns made it back to the NFL Championship Game a year later, but, on Jan. 2, 1966, fell at Green Bay, 23-12.

Jan 2, 1966; Green Bay, WI, USA; FILE PHOTO; Cleveland Browns running back Jim Brown (32) follows John Wooten (60) and Gene Hickerson (66) during the 1965 NFL Championship game against the Green Bay Packers at Lambeau Field. The Packers defeated the Browns 23-12. Mandatory Credit: Malcolm Emmons-USA TODAY Sports

The team was young enough to imagine more title runs. No. 32 was 29 years old. So was the quarterback, Ryan. Collins, 25, and Warfield, 23, were tremendous young receivers.

No. 32 thought he might be back for 1966, but he wanted to see how things went in London, where “The Dirty Dozen” was being filmed. He had an important role in a cast including Lee Marvin, Ernest Borgnine, Charles Bronson and Telly Savalas. It became MGM’s hit of the year.  

No. 32 resolved to stay in London as long as it took. Modell treated the retirement talk as a bluff, as No. 32 noted in “Out of Bounds”:

“Art issued a public ultimatum. He told the press if I didn’t show up on time for camp, I would be fined $100 for each day I missed. Had Art not done that, I might have returned. Art’s edict directly removed that possibility.”

PB was long gone, and now, with the second 10 years of Cleveland Browns football in the books, Jim Brown was out.

Cleveland Browns fullback Jim Brown turns the corner against the Green Bay Packers in the NFL title game, Jan 2, 1966 photo in Green Bay, Wis.

PB and No. 32 are forever linked. Eventually, prior to Paul Brown’s death in 1991 and Jim Brown’s in 2023, (complications from pneumonia claimed them both), they made peace.

No. 32 said he couldn’t have played for Vince Lombardi, who learned from PB before he became head coach of a Packers dynasty. From “Out of Bounds”:

Dec 12, 1965; Los Angeles, CA, USA; FILE PHOTO; Cleveland Browns running back Jim Brown (32) against the Los Angeles Rams at the Memorial Coliseum.

“Unlike Paul, Lombardi was a hollerer and a name caller. I didn’t respond to that. I would have done one of two things, totally withdrawn or gotten in Lombardi’s face, and neither would have been good for the team. Paul might have been a tyrant, but he was my tyrant.”

Paul Brown and Jim Brown chanced to meet on Jan. 24, 1982, the day PB’s second team, the Bengals, faced the 49ers in Super Bowl XVI.

“I hadn’t seen him in a lot of years,” No. 32 wrote. “He seemed glad to see me, and I was happy to see him.”

The old coach invited the retired player to a charity golf scramble in Dayton, billed as “Paul’s Guys.”

PB arranged a foursome that included himself and No. 32. Jim made a few putts that helped the team. Paul treated it as if they were trying to beat the Jack Nicklaus group.

“It was this sweet, crazy deal,” Jim wrote.“ Paul and Jim back together. Paul was still the general, deciding how to play the holes, and I was the guy coming through for him.

“I flew back home on this lovely high.”

Reach Steve at steve.doerschuk@cantonrep.com

This article originally appeared on The Repository: Paul Brown, Jim Brown and Modell. Browns story of the decade, 1956-65