1. Do you need support for Assetto Corsa Competizione? Please use the proper forum below and ALWAYS zip and attach the WHOLE "Logs" folder in your c:\users\*youruser*\AppData\Local\AC2\Saved. The "AppData" folder is hidden by default, check "Hidden items" in your Windows view properties.
    Dismiss Notice

ACC Blog The ACC Rating System - PART II (Long version)

Discussion in 'ACC General Discussions' started by Minolin, Oct 10, 2018.

  1. Minolin

    Minolin Staff Member KS Dev Team

    Today, we will release version 0.2 of Assetto Corsa Competizione. Additionally to exciting gameplay features like pitstops, the (sprint) race weekend and new content such as the first-gen Bentley Continental GT3 and Misano circuit, you will find the following two Ratings on the roadmap: Safety and Performance (Racecraft).
    First, there is a small change of plans. In the first (link) blog post about Release 1 ratings, we were talking about 6 progression ratings that unlock one another. That was the defensive approach, but given how successful especially the very important Car Control rating has turned out to be, we could decide to implement the Safety Rating as progression rating as originally planned. It will take its place between the Pace Rating and the Racecraft rating, so this will be the overview:


    [​IMG]

    RECAP 0.1 RATINGS
    As we already know, the Ratings will start with the basics, and unlock gradually based on the driver’s performance. In a short recap about the first 4 ratings we already implemented in the first release, we are very pleased with both how they work and how the community perceives them.

    In the best example (link) we had a quite experienced driver doing laps of 1:58 on the Nürburgring. He felt he was doing fine, but for a reason he couldn't exceed a Car Control Rating of 54% – so he came to our forums and asked for advice. A few days later he improved to unbelievably low 1:53 laptimes, scoring a top 10 rank in the Hotlap Leaderboard! And he was not alone, many other drivers have also reported improvements.

    For this reason, we re-thought how to present the rating data in the UI, so drivers can understand and learn as much as possible for future releases. As a short-term solution, we invented a HUD option that allows the user to set the selected Rating in the Rating Widget during Practice sessions. This way drivers can just work with the feedback and improve their driving as they like.

    upload_2018-10-10_15-9-51.png



    SAFETY RATING (SA)

    Disclaimer: This is the description of the full vision, I will close with the state and plan of implementation steps

    We are excited to present you the first implementation of a Safety Rating in Assetto Corsa Competizione. Sadly, the simracing Multiplayer experience is very vulnerable to both malicious trolls or inexperienced drivers who cause accidents that can ruin the race for most of the drivers in turn 1. Traditionally, the Safety Rating in simracing is used to detect clean drivers in Multiplayer and create special servers where they can race without disturbance.

    The disadvantage is obvious: While there is an elite of very clean drivers who may have a good time, most users are locked out from high-quality racing and need to improve their rating against other drivers that are not as clean. Overall this leads to a frustrating and discouraging experience, effectively increasing the difficulty to get into simracing in the first place.

    You probably noticed that one of our missions is to enable newcomers and part-time simracers to get into Assetto Corsa Competizione – and simracing in general. For this reason, the Safety Rating is set up differently: first, it applies to both Singleplayer and Multiplayer race action. The AI is reliably clean and will always obey the racing rules we set up. This is a fair way to watch drivers in traffic, without the variables of other humans. Actually, you will have to prove yourself against the AI before you can enter rated Multiplayer servers. Consider it as the entry trial for the cleanest Multiplayer experience ACC will offer.

    Given the opportunity to learn and recover in protected Singleplayer game modes, we also void the necessity to run rated servers for less clean drivers, and expect them to magically improve there, adding lots of randomness in the picture.

    Secondly, the Safety Rating is implemented in a way to consider clean and good racing versus the number of incidents caused. I used to call this "accidents per opportunity to do so", which translates in "Trust" and "Online Behavioural Warning Points" (short OBWP, derived from the BWP used in the Blancpain GT series). You earn Trust while being in dangerous situations, close to other cars. The hotter the race action is, the more Trust drivers gain. It obviously peaks out if you drive bumper-tobumper or even side-by-side; but take care: you also need to have your car under control and must avoid accidents. You will gain gradually less Trust for less dangerous situations, and none when you are driving outside a certain range of other cars. This means you also rely on the basics: knowing the track is vital, you need consistency to stick with other cars, you need to have your car under control, and of course a certain race pace is required. Yes, this is exactly the order of the previous Ratings: TR, CN, CC, PC. You see how everything comes together here.

    Contacts and accidents will score OBWPs, based on the severity of the outcome of a contact. Therefore you won't see Online Behavioural Warning Points for a short bump which doesn't even impair the other car, while the amount of OBWPs gradually increases for pushing the other car out of control, out of the track, into a different car and so on. Full points are assigned when the other car is going far off the track, spins out or crashes into another car.

    The third aspect of the Safety Rating is that it is prepared to analyse accident situations. To be very clear up front: the core reason is not to distribute OBWPs according to guilt. The primary reason is to understand when the driver made a mistake and being able to give him appropriate feedback: what went wrong, what rule was violated, how to avoid such accidents. This is going to make for a better simracing experience for everyone, not just try to protect the good and experienced guys from getting too many points.

    We do understand that it is frustrating to be "rewarded" with points for accidents where you are not considered guilty, but it is getting really complicated here. I will keep this short: the system is designed in a way that you will obviously have OBWPs even as a clean gentleman racer, I mean it is racing after all. If you are good, you will also have earned so much Trust that a few OBWPs won't hurt your Safety Rating, and it is entirely possible to have a 100% SA rating with significant OBWPs, if you also have earned significant Trust.

    Keep in mind that the rated servers may look differently to what you know from previous Safety Rating implementations: we will have the Singleplayer entry barrier and a very interactive feedback of rules and observations. This should lead to a considerably high quality in Multiplayer in the first place

    And lastly, there is an advanced discipline of accident avoidance even if you didn't do anything wrong – a system that wouldn't appreciate awareness, cleverness and evasive skills couldn’t be considered good, right? I couldn't describe this better than quoting from one of the many discussions I had with real Blancpain drivers about the topic:

    This was the overall vision of what we want to achieve. Please understand that this will be a process during the whole development of Assetto Corsa Competizione, based on feedback, numbers, statistics and development time. Now you will see the basic functionality of Trust and OBWPs, combined to a rating. The outcome of an accident is considered, while the accident analysis and its feedback will be delivered and updated with each further update.

    upload_2018-10-10_15-12-21.png



    RACECRAFT (PERFORMANCE) RATING

    Disclaimer: This is the description of the full vision, I will close with the state and plan of implementation steps

    Once you hit 50% Safety Rating, the Racecraft Rating will unlock. It is meant to measure the relative performance between drivers, again expressed in a 0-100% scale of RC Rating.
    The top-level description is quite simple: come in first, and you will have a good RC rating. But of course, reality is deeper, and only one can finish a race in the first position. :D

    One of the worst disadvantages of running traditional performance ratings is that they develop a considerably high frustration potential: it is fun while you are increasing your rating with every race you participate in; but once you’ve reached the Rating that expresses your actual strength, you can only increase it further by improving your factual driving performance (which is very difficult). On the other hand, you can lose a lot by doing mistakes, or even worse: get taken out by another driver. This leads to the phenomenon that good performance ratings tend to decrease drivers’ contribution – they just don't race as much as they would like to!

    Assetto Corsa Competizione's Racecraft rating addresses this issue by not taking too much care of the race result, but focus on the fight for positions, and permanently calculate the Rating, instead of just using the standing at the end of the race (where a single mistake can have this huge impact). Technically speaking, the system has two paths to manipulate the Racecraft Ratings of drivers:
    First, the system builds a relationship to cars that are close and considers them being in a fight. You enter the fight when your car is near to another one (think of 0.3 - 0.4s) and ends the situation when the leading car could create a considerable gap (~1-1.5s) – or an accident occurs. While in a fight, both drivers are constantly averaging their ratings (in very tiny steps). So, if you can follow a driver with a much better rating, your Rating will improve. If you are followed by a driver that is rated worse, you are expected to be quicker – and you should be able to draw away soon. The longer this takes, the more RC Rating will be transferred to him, lowering the net result when you finally build your gap and end the fight situation. Obviously, you score points by doing so, but the net result decreases the longer the operation takes.
    Overtaking as such does not affect the rating in a special way, because any outcome is already covered by the math described above – if you are behind a driver that is rated worse, you are expected to pass him and draw away. So, the longer this takes, the less RC rating you will earn, up to a point where you can even lose a bit despite eventually passing him.

    Please note that those adjustments are tiny, and will only give real results after many, many races and fights completed. The closer two drivers are in their Rating, the less movement will happen – up to a point where only major events are able to create tiny adjustments at all.


    In a second path, the RC rating will consider the race standing. It should make a difference if you are running in the first or last place, so in the long run even an alien that is basically never involved in a fight but wins any race will see his RC Rating become very high – but the process will be a lot slower than if he were to be involved in serious combats.

    In a recap, the RC rating is meant to support the fun part of racing, and slowly but steadily build a ranking of actual racing performance (while considering driving standards).
    We tried to address the worst side effects, while providing a tool that should be fun to engage and give a sensible measurement of performance. Obviously, this will be one(!) of the more important metrics when we try to find a good Multiplayer server for you!

    Speaking of Multiplayer - the way of how the Rating's math works makes it also very suitable to be used in the Singleplayer as well! Yes, AI drivers have a RC rating as well, based on their strength, aggressiveness, consistency and other values – even considering the local difficulty you have chosen. Just like the Safety Rating, Racecraft is not a Multiplayer thing only. Go out, compete with the AI and improve your Racecraft.

    Again, for this release, the core Rating is implemented, but we will use the Early Access to understand if our assumptions and numbers are correct. For future releases, we will improve the rating, so it can be considered a perfectly fair tool to serve the intended purpose, so please let us know about your thoughts and observations.

    upload_2018-10-10_15-13-29.png

    At the moment, the Rating Widget will give you a hint about being in a fight situation to the front or to the car behind (but you can be in more than 2 fights at a time). The message will also indicate what is expected; for example, if you follow a driver with a similar or lower RC Rating, it will indicate to pass the car. If the driver is considered better than you, the message will be to stick with him – there are still good points to earn for you.


    NOTICE ABOUT THE AI DRIVERS
    With this release, each AI driver has a unique character, derived from his real-life performance during the season. Expect Gold and Platinum drivers to be considerably faster and more resolute than Bronze drivers, but also be aware of special characters within the brackets of the FIA category. Watch drivers, observe their behaviour, build trust, learn who you need to take care of in certain situations. It will take some time, but in the end, it will pay out.


    Have fun with this update, and keep the feedback coming!
    Thanks so much for your support
     

    Attached Files:

    Last edited: Oct 25, 2018

  2. Similar Threads
    Forum Title Date
    ACC General Discussions DriverProfile / Rating (ACC 0.3) Nov 14, 2018
    ACC Controls & Peripherals Error with accelerating and stopping Sep 16, 2018
    ACC General Discussions The ACC Rating System - PART I - We want to help you improve Sep 7, 2018
    Physics Bugs & Issues Gt-r and gt-86 don't squat when accelerating from a stand still Aug 1, 2015
    Troubleshooting - Workarounds All bmw cars not accelerating Mar 15, 2015
    Graphics and Models/Tracks Bugs & Issues Fps drop in corners and when accelerating + scaling issue since 1.1 Mar 14, 2015
    Sounds modding Why in the heavens is the low revs lagging/glitching when accelerating gently???? Feb 15, 2015
    Suggestions Adding g-force-effect on cockpitview when accelerating (dont see it yet). Dec 16, 2013
    Controllers and Peripherals Bugs & Issues G27 Car keeps breaking when not accelerating. Nov 10, 2013
    ACC General Discussions Epic Games vs Steam - Which Distribution Platform for ACC? Saturday at 9:45 PM
    ACC General Discussions Realtime app for ACC? Saturday at 7:07 PM
    ACC Controls & Peripherals SRM Fanatec conversion kit / ACC / Slimax issue Saturday at 6:42 PM
    ACC Troubleshooting ACC doesn't open Saturday at 5:28 PM
    ACC Multiplayer Cannot access MP lobby Saturday at 2:29 PM
    ACC Troubleshooting Multiplayer Fatal Error V0.4.1, ACC Official Server, Logs attached Saturday at 12:39 AM

  3. xemxem

    xemxem Rookie

    Wow. Racing gonna be double fun!
     
  4. Stefanoes

    Stefanoes Rookie

    Wow, this sounds really amazing!
    Thank you for this blog. I can't wait to try the update.
     
  5. Seems to be a fair concept, lets see in pratice.
     
  6. Kopiller

    Kopiller Racer

    Minolin you are nuts jajajaja good work!!
     
  7. anything-but

    anything-but Simracer

    As a mainly mp simracer, this post pleases me immensely!

    This journey is gonna be a fun one. :)
     
    Rehooja likes this.
  8. I like the part of getting OWBP points even if you are "not guilty".
    It really sucks when you get into the T1 big mess. But what about breaking early and give some more space? (I know it's not easy, I fall for this sometimes, but hey at least try :p )
    But it's even worse when you are fighting for the position maybe when in overlap with another driver and ends up with both cars into the gravel pit. This sistem has potential to teach people to step off the gas even if they are "in the right"
     
  9. henkjansmits

    henkjansmits Rookie

    Im not so sure about this given how I got into simracing:

    "You probably noticed that one of our missions is to enable newcomers and part-time simracers to get into Assetto Corsa Competizione – and simracing in general. For this reason, the Safety Rating is set up differently: first, it applies to both Singleplayer and Multiplayer race action. The AI is reliably clean and will always obey the racing rules we set up. This is a fair way to watch drivers in traffic, without the variables of other humans. Actually, you will have to prove yourself against the AI before you can enter rated Multiplayer servers. Consider it as the entry trial for the cleanest Multiplayer experience ACC will offer.

    Given the opportunity to learn and recover in protected Singleplayer game modes, we also void the necessity to run rated servers for less clean drivers, and expect them to magically improve there, adding lots of randomness in the picture."

    I quite liked (at least in the beginning) the opportunity to "goof around" with human players. Not in the sense of wrecking on purpose etc., but more in the sense of racing with other beginners that would spin out their car at turn 2 etc., without having the worry about "rating". Basically what are now the public servers in AC. So I hope that space is not taken away, because i think that will achieve the opposite of the intended effect: it will deter beginners from simracing. I already find this is a barrier to racing in Project Cars 2 public servers: ohoh what will happen to my rating. And you see the effect in PCars 2: lots of unrated servers (in the sense that you dont need a minimal rating to get in).

    The AC (and ACC) AI is also quite boring (I only like the rfactor 2 one for single player...) so I would prefer not to spend too long in single player purgatory.

    So in summary: rating can be intimidating for beginners and while its required if you get into simracing a bit more it should not be a barrier to entry.
     
  10. ZioYuri78

    ZioYuri78 Hardcore Simmer

    It's looks funny, also be rewarded because i have a clean fight for a lower place it's a good thing, great for average drivers like me that maybe doesn't have the skills for a 1st place fight, i like it :)
     
    AmirHM, bieroX, vlado Cro and 3 others like this.
  11. mailanmanu

    mailanmanu Rookie

    Thanks for this detailed post Minolin!

    I consider myself a beginner and i enjoy very much the ideas you want to
    put into ACC. I'am excited to see how this works out into practice
    and how much "fun" this is going to be :)

    I have one additional thought to your post...

    In addition to your very elaborate rating ideas i hope that
    you consider a lot more visual feedback after a Race, Stint
    or Hotlap, because for me as a beginner it is hard to
    parse the rating feedback while driving. I hope
    you have some ideas to make all your rating math
    visible to beginners in a clean and understandable
    way. For example, i imagine something like a rating
    Summary at the end of a Stint to see in which
    turn i have to improve or in which situation it
    would have been better to take care.

    Parsing all this valuable info while racing through
    a tiny widget could be a little to less visual output
    for these very very good ideas and implementations.
    A quiet moment after a Race studying all this data -
    that would be the pinnacle of enjoyment for me :)

    Thanks again for your hard work - cant wait
    to try your new ratings out after work :)
     
    atw, AmirHM, d34n.07 and 7 others like this.
  12. BEsnake

    BEsnake Racer

    Soo not qualifying would be bad if you get stuck behind slower people? eitherway i love the sound off this system. It wil atleast force me to qualify and start in the mid of the pack instead of safely starting at the back and pass the slower people first. since i get better ratings by driving at my level from the start instead of going the easy route of just passing slower people
    Well i love the fact that it wil make me a slightly more agressive driver instead of patiently waiting for slow people to make mistakes and/or just let me past
     
  13. Ni-MH

    Ni-MH Gamer

    Really impressive, thanks for the work.
     
    Rehooja and Dany88 like this.
  14. Arpadian

    Arpadian Racer

    sorry but how can improve when...

    "you will have to prove yourself against the AI before you can enter rated Multiplayer servers. Consider it as the entry trial for the cleanest Multiplayer experience ACC will offer"
    .
    if i can barely play with 6 AI before it get massive Framedrops?, how i'm supposed to improve vs ai when i cant even race then...?

    doesn't look fair for many ppl who have mid end pc and cant race against AI
     
  15. Winston

    Winston Racer

    Brilliant , looking forward to resting it.
    @Minolin I know we all hope it won't be required but do you plan to have any vote to kick function?
    I'm not requesting it, just wondered what you are planning.
     
  16. liakjim

    liakjim Alien

    Exactly

    Στάλθηκε από το m2 note μου χρησιμοποιώντας Tapatalk
     
  17. mantasisg

    mantasisg Racer

    This is absolutely amazing ! Congratulations :)

    By the way, I have already suspected that AI had different characters in R1 already :) great stuff :)
     
  18. Naer

    Naer Gamer

    That is amazing!!

    I like this part:

    Would be so cool if the crew chief say things like that by radio, like some kind of spotter. I know there isn't spotter in Blancpain, but is really usefull in online races...
     
    BEsnake likes this.
  19. domidomi

    domidomi Rookie

    Very exciting!

    I just want to make one short note on the Trust/OBWP system. I'm very excited to see a two-dimensional system of rating safety. I think historically sims (and videogames in general) error in the direction of rating the user on a one-dimensional slider, where the better you do - the higher the score, and vice versa. I think this is not simply poor design, but also diminishes incentive to be disciplined in one's good approach. I think it's intuitively true, and everyone can agree, that many individuals are very good at being good, AND very good at being bad, and that needs to be categorized as completely different and separate from people who are neither good, nor bad. The 'average' racer mingles poorly with these 'ambi-valent' racers, and any system which ranks them in the same group will produce subpar racing. This is, of course, just my opinion, but i think we can all think of examples of race drivers who are very quick, prone to making mistakes, and when they do error, they bully their way through the pack, thereby worsening the safety rating of the 'average' racers with poorer, but consistent pace.
    I really hope this system manages to keep the two parties separate. HYPE!!!
     
    chksix likes this.
  20. earlyapex

    earlyapex Racer

    I don't like the way you have race craft set up. It should have nothing to do with how fast one laps. Leading from pole to flag and not seeing another car all race displays zero race craft.

    On the other hand, if I am racing and am ahead and have higher race craft rating than the car behind because I'm good at defending but the car behind is quicker but can't race others and has poor race craft rating as a result, why should my points transfer to him if I am able to keep the quicker car behind me by displaying good race craft?
     
  21. liakjim

    liakjim Alien

    This system is really familiar to people that were playing in MR servers. Nice additions too. I am also worried about the AI approach of approve since my pc struggles with AI cars but might be ok for multiplayer sessions.

    Στάλθηκε από το m2 note μου χρησιμοποιώντας Tapatalk
     
    Leeuwtje likes this.

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice