Discussion Board
Welcome Guest! You can login or register. Login or Register.

Options
Go to last post Go to first unread
Nonstopdrivel  
#1 Posted : Wednesday, November 14, 2018 2:10:34 PM(UTC)
As we all know (or should know, anyway), the NFL passer rating is strictly a measure of passing efficiency; it does not take into consideration a quarterback's rushing statistics. The four statistical categories that comprise the NFL passer rating are completion percentage, yards per attempt, touchdowns per attempt, and interceptions per attempt. The formula was designed in the 1970s to rate an average performance for a quarterback of that era as 66.7 and an excellent performance as 100.0.

The nice thing about this formula is it is an "absolute" measure that allows us to compare quarterback passing performances across eras. The disadvantage is that it the scale is artificially flattened at both ends, such that it's impossible to get higher than a 158.3 or lower than a 0.0, and it doesn't take into consideration a quarterback's rushing attempts or his fumbles. It's a passer rating, not a quarterback rating. The other problem is that it fails to account for season-to-season variation in leaguewide performance, so it makes it more difficult to get a feel for how quarterbacks are performing relative to each other on a year-to-date basis. For example, a passer rating of 110.0 looks great on paper, and if the league average is 85.0, it really is impressive; but if the league average is 105.0 this year, a 110.0 rating doesn't stand out nearly so much.

For these reasons, I thought I would try my hand at designing a more open-ended, relative quarterback rating system that would take passing, rushing, and turnovers into consideration while minimizing the effects of changes in the landscape of the league from season to season.

Below is a table comparing three different preliminary versions of the rating system, so you can get a feel for how they vary in the results they return. I want to get your feedback as to which one you think returns the most useful results and/or your suggestions for ways to improve the formulas further.

Rating a weights the following statistical categories equally: yards per passing attempt, yards per rushing attempt, touchdown:turnover ratio, and completion percentage. The weighting of the rushing category hurts quarterbacks who are statues in the pocket, while the inclusion of completion percentage favors dink-and-dunk quarterbacks.

Rating b weights the following statistical categories equally: yards per play, touchdown:turnover ratio, and completion percentage. Lumping rushing and passing together in a single category like this inherently weights rushing and passing yardage by the number of attempts; this favors immobile quarterbacks at the expense of rushing quarterbacks, since not even the most run-happy quarterback rushes nearly as often as he passes.

Rating c weights the following statistical categories equally: yards per play and touchdown:turnover ratio. The advantage of this method is its simplicity; it measures a quarterback's efficiency at moving the ball down the field and avoiding turnovers. The disadvantage is that it could arguably be considered more of an offensive rating than a quarterback rating, although it really isn't, since it ignores rushes by anyone not the quarterback.

It's worth emphasizing that this is a relative quarterback rating. It's not based on a body of statistics from prior seasons -- it rates quarterbacks against each other with respect to their relative performances this year. It gives you the ability to more consistently and objectively define terms like "elite" and "mediocre" from season to season. If you want to define an elite quarterback as one whose performance is in the 95th percentile or above (my personal definition), then it's obvious that there is only one quarterback in the league this year who is playing at an elite level across statistical categories.

Code:
Player			  Rating a	  Rating b 	  Rating c

Drew Brees		    81.05		99.43		104.49
Philip Rivers		51.86		65.77		 69.45
Patrick Mahomes		62.02		64.85		 68.53
Jared Goff		    59.16		65.98		 68.06
Ryan Fitzpatrick	61.65		63.52		 66.38
Matt Ryan		    61.16		65.37		 62.97
Mitchell Trubisky	61.32		54.96		 56.01
Aaron Rodgers		52.54		50.39		 55.95
Russell Wilson		58.92		55.25		 55.67
Deshaun Watson		56.45		53.73		 55.09
Ben Roethlisberger	51.60		53.65		 53.12
Jimmy Garoppolo		47.61		46.52		 52.46
Carson Wentz		56.39		58.17		 52.33
Jameis Winston		54.08		50.37		 50.05
Derek Carr		    50.03		55.31		 47.27
Tom Brady		    43.06		48.72		 47.12
Cam Newton	     	54.44		51.94		 46.84
Eli Manning		    44.76		50.94		 46.74
Andy Dalton	     	46.58		46.07		 46.38
Kirk Cousins		50.89		54.15		 45.84
Case Keenum		    45.94		46.04		 45.57
Ryan Tannehill		50.96		48.28		 45.37
Marcus Mariota		53.22		48.98		 44.72
Matthew Stafford	46.90		48.63		 44.51
Blake Bortles		49.71		42.94		 44.47
C.J. Beathard		43.25		41.42		 43.58
Baker Mayfield		46.90		42.44		 42.94
Dak Prescott		49.39		44.72		 42.81
Alex Smith		    45.39		44.02		 41.76
Andrew Luck		    44.55		46.15		 41.56
Brock Osweiler		41.37		43.14		 41.38
Joe Flacco		    37.65		38.57		 38.08
Sam Darnold	    	31.91		30.52		 35.57
Tyrod Taylor		37.20		23.52		 33.72
Josh Rosen		    36.32		29.93		 33.45
Josh Allen		    33.77		25.63		 29.77


Legend:
		  Standard deviations 
Scale	            from mean      Percentile      Evaluation
 100                    +3.0            99.9         Stellar
  50                     0.0            50.0         Average
   0                    -3.0             0.1         Shitty


If anyone wants an in-depth description of the mathematics behind the three rating systems, I'll be happy to provide it.

What do you people think? What did I get right? What did I get wrong? What did I miss that I should have included, or what did I include that I should have left out?

Updated by user Wednesday, November 14, 2018 5:15:01 PM(UTC)  | Reason: Not specified

Zero2Cool  
#2 Posted : Wednesday, November 14, 2018 2:30:15 PM(UTC)
Somehow, plays per turn over at the fault of QB.
Passes that hit receivers hands and should have been caught, count as completion.
Passes that were tipped and picked off, do not count as even a pass attempt.
Passes thrown away due to coverage.
Sack ownership.
Nonstopdrivel  
#3 Posted : Wednesday, November 14, 2018 2:51:59 PM(UTC)
A few things that stand out to me:

1) When it comes to efficiency, Drew Brees is absolutely the class of the NFL this year. There is no one remotely on his level. These ratings look favorably on quarterbacks who protect the football, and no one is protecting the ball as well as Brees this season. His 24.0 TD:TO ratio is probably unprecedented in league history. (By way of comparison, Philip Rivers has the next best ratio at 5.3.) Not to mention Brees' 77.3 completion percentage is 6 points higher than Derek Carr's (71.5) and Kirk Cousins' (71.3). That is simply unearthly. Brees is probably going to run away with the MVP vote his year, if Mahomes doesn't steal it from under his nose.

2) Aaron Rodgers' pedestrian yardage averages are dragging down his ratings; in both passing and rushing, he has been thoroughly middle-of-the-road this year. More importantly, his three lost fumbles loom large. If it weren't for the lost fumbles, he'd be a top-three quarterback this season in all three systems. It's just hard to compete with a quarterback who's only lost the football once this season despite passing over 33 times a game. Remember, these are relative systems. If Brees suddenly starts losing the football , Rodgers' rating will shoot back up.

3) Rookies will be rookies. Three of the bottom five and four of the bottom ten quarterbacks so far this season are rookies. On the other hand, given the right coaching, quarterbacks can develop quickly: two of the top five quarterbacks have been in the league less than three full seasons.
Nonstopdrivel  
#4 Posted : Wednesday, November 14, 2018 2:57:37 PM(UTC)
Zero2Cool said: Go to Quoted Post
Somehow, plays per turn over at the fault of QB.

What?

Zero2Cool said: Go to Quoted Post
Passes that hit receivers hands and should have been caught, count as completion.
Passes that were tipped and picked off, do not count as even a pass attempt.

Ha! You have the money to hire an army of nerds to watch tape?

Zero2Cool said: Go to Quoted Post
Passes thrown away due to coverage.

This would be feasible if I had a parser to collect that kind of data from the play-by-plays posted on the NFL website. I worked on one with a buddy a few years ago and even got it working reasonably well, but I eventually had to abandon the project.

Zero2Cool said: Go to Quoted Post
Sack ownership.

Sacks aren't included in this rating system yet. I was thinking of putting them in there, but again, without someone to watch tape, it would be hard to decide which sacks were the fault of the line and which were the fault of the quarterback. In the end, I suppose, all quarterback rating systems end up being offensive rating systems.
Zero2Cool  
#5 Posted : Wednesday, November 14, 2018 4:50:43 PM(UTC)
Plays the QB is responsible for the turnover. Fumble because QB is dumb. Interception because he threw it into coverage. Exclude tip at line passes caught and picked. Let's get serious with this! Let's go!


Parsing the data isn't the hard part. It's storing in a manner that's retrievable that caused me headaches.
Nonstopdrivel  
#6 Posted : Wednesday, November 14, 2018 5:20:13 PM(UTC)
It's not hard designing a parser that will get the data 90% or 95% right. The hard part is that last 5% or 10%. There are so many subtle outliers. A few NFL statisticians seem to have a fondness for writing up plays in their own idiosyncratic ways; some of them use slightly nonstandard phrasing, others include details most other statisticians don't, and a few include less information than others. Those are the cases on which the parser tends to gag, and although it's only a few plays a week, it adds up over the course of the season. Some of the errors are subtle, so you have to be on the lookout and do a lot manual crosschecking while you're designing the parser rules. But it's definitely something I'd love to get operational one of these days. NFLGSIS makes it very easy to download the data.

Here's a fun example:

Code:
(5:04) (Shotgun) D.Brees pass short right to M.Thomas for 5 yards, TOUCHDOWN. 
Brees throws 501st career touchdown pass.

Updated by user Wednesday, November 14, 2018 6:11:03 PM(UTC)  | Reason: Not specified

Nonstopdrivel  
#7 Posted : Wednesday, November 14, 2018 6:15:40 PM(UTC)
Here are some examples (two consecutive plays, actually) where the statistician judges the receiver to be at fault for an incompletion:

Code:
(11:36) (Shotgun) D.Anderson pass incomplete short middle to C.Ivory. 
Dropped at NE 41, crossing from right.
(11:31) (Shotgun) D.Anderson pass incomplete short right to K.Benjamin. 
Through receiver's hands, along sideline at NE 30. Penalty on BUF-K.Benjamin, 
Offensive Pass Interference, declined.


So it's certainly doable.
Zero2Cool  
#8 Posted : Wednesday, November 14, 2018 8:43:46 PM(UTC)
You can do it! I got faith in you.
Rss Feed
Users browsing this topic
Guest
Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

Notification

Icon
Error

Fan Shout
gbguy20 (1h) : Still no bye week listed Kevin. Don't you know what you are doing? young idiot
Zero2Cool (5h) : Only thing I can guess is how Falcons used Taylor Gabriel.
Zero2Cool (5h) : if anything, they like his open field ability and figure if they can get the ball to him in the flat from backfield = win
Zero2Cool (5h) : More so thinking it is just not leaving any stone unturned.
Cheesey (5h) : I’m not questioning you Zero, just trying to figure it out. Is Davis that good that they are trying so hard to find a spot where he can play?
Cheesey (5h) : Why would they try a last ditch effort? I mean, if they have to try THAT hard, is he really worth it?
Zero2Cool (10h) : Keep in mind the quick little fast guys that the Rams, Falcons used. They might see Trevor in that role.
Zero2Cool (10h) : More than likely, this is a last ditch effort to find a spot for Trevor.
Cheesey (19h) : I agree gbguy. He must have a relative in a high position on the Packers!
gbguy20 (22-May) : except ty was actually good (at both positions) where Trevor has never shown a reason to be on the 53. how he has been here for so long escapes me
wpr (22-May) : It's the Montgomery experiment all over again.
gbguy20 (22-May) : Trevor Davis practicing as a RB during OTAs. what the hell
Zero2Cool (22-May) : Folks usually say the series don't start until road team wins
TheKanataThrilla (22-May) : There was a stat that indicated that home crowd was most important in basketball of the big 4 sports. Not sure why.
Zero2Cool (22-May) : Raptors are simply better team top/down, and two of their main guys are hobbled.
Zero2Cool (22-May) : And didn't learn from past mistakes and lost Game 4.
Zero2Cool (22-May) : Bucks should have lost Game 1, got lucky. Dominated Game 2. Screwed up in Game 3.
Zero2Cool (22-May) : I don't think they are gonna make it to the Finals. No effort, no heart last night.
buckeyepackfan (22-May) : Don't panic Cheesey, series will go 7 games. NBA needs that to happen.
Cheesey (22-May) : Bucks stunk it up tonight. If they keep this up, they will be WATCHING the championship on TV.
TheKanataThrilla (22-May) : Congrats Blues. Stanley Cup bound.
gbguy20 (22-May) : i c u cheesey
Cheesey (21-May) : Yeah....would have been good “JU JU”! LOL!
Zero2Cool (21-May) : Should have taken JuJu Smith-Schuster instead of Josh Jones
Zero2Cool (21-May) : " So I think it's a good opportunity for those guys to get the bulk of the reps. I think everyone in here is comfortable what Davante is about."
Zero2Cool (21-May) : LaFleur says Davante Adams is present, but he did not practice: "Just precautionary, and ... we do have some young receivers. So I think it's a good opportunity for those guys to get the bulk of the r
Nonstopdrivel (21-May) : They won another Eastern Conference Championship in '74.
Nonstopdrivel (21-May) : They won it all in 1971.
gbguy20 (21-May) : im assuming not
gbguy20 (21-May) : have the bucks ever won it all?
Cheesey (21-May) : Yup.hes best taking it to the hoop.
gbguy20 (20-May) : the nba 10 years ago vs now
Zero2Cool (20-May) : and I do NOT want Giannis taking 3's unless we are up by double digits. Period.
Zero2Cool (20-May) : and it was bumbled up and a turnover. TAKE THE DAMN SHOT
Zero2Cool (20-May) : So many times it looked like clear lane to the hoop and instead of the layup, they did an awkward pass
Zero2Cool (20-May) : That was another thing that boggled my mind.
Cheesey (20-May) : True. So many missed shots. These guys are pros, yet can’t seem to make a free throw???
Zero2Cool (20-May) : 12 points wasn't the issue, it was his 8 turnovers. And the stupid ass passing in the paint. Just take the damn lay up.
Cheesey (20-May) : Held the Greek freak to 12 points. That sure didn’t help us.
Zero2Cool (20-May) : Always feel home team gonna win game three. But once OT hit, I felt it was ours.
Cheesey (20-May) : They had plenty of chances. They just plain blew it.
Zero2Cool (20-May) : Bucks didn't win, crap!
Zero2Cool (19-May) : It'll be canceled before the month is up 😜
gbguy20 (19-May) : dangit
Zero2Cool (19-May) : You have to pick a package. I think they have an NBA package. I just bought the $25 that gave me ESPN TNT and TBS to ensure NBA games.
gbguy20 (18-May) : from*
gbguy20 (18-May) : do you have to pick ftom "packages" with sling or can you legit individually pick the channels you want?
Zero2Cool (18-May) : and ya can cancel anytime ...
Zero2Cool (18-May) : Sling TV is $25 a month.
nerdmann (18-May) : My SkyStreamer is running great.
Please sign in to use Fan Shout
2019 Packers Schedule
Thursday, Sep 5 @ 7:20 PM
Bears
Sunday, Sep 15 @ 12:00 PM
VIKINGS
Sunday, Sep 22 @ 12:00 PM
BRONCOS
Thursday, Sep 26 @ 7:20 PM
EAGLES
Sunday, Oct 6 @ 3:25 PM
Cowboys
Monday, Oct 14 @ 7:15 PM
LIONS
Sunday, Oct 20 @ 12:00 PM
RAIDERS
Sunday, Oct 27 @ 7:20 PM
Chiefs
Sunday, Nov 3 @ 3:25 PM
Chargers
Sunday, Nov 10 @ 12:00 PM
PANTHERS
Sunday, Nov 24 @ 3:25 PM
49ers
Sunday, Dec 1 @ 12:00 PM
Giants
Sunday, Dec 8 @ 12:00 PM
REDSKINS
Sunday, Dec 15 @ 12:00 PM
BEARS
Monday, Dec 23 @ 7:15 PM
Vikings
Sunday, Dec 29 @ 12:00 PM
Lions
Think About It
Think About It
Recent Topics
5h / Random Babble / Zero2Cool

8h / Green Bay Packers Talk / wpr

11h / Random Babble / Zero2Cool

22-May / Green Bay Packers Talk / beast

22-May / Packers Draft Threads / wpr

21-May / Green Bay Packers Talk / buckeyepackfan

19-May / Green Bay Packers Talk / nerdmann

19-May / Green Bay Packers Talk / KRK

17-May / Green Bay Packers Talk / gbguy20

17-May / Random Babble / Cheesey

15-May / Green Bay Packers Talk / nerdmann

15-May / Green Bay Packers Talk / Cheesey

14-May / Green Bay Packers Talk / TheKanataThrilla

14-May / Green Bay Packers Talk / yooperfan

14-May / Green Bay Packers Talk / gbguy20

Headlines