Root ROM Rating System - Yes or No?

Discussion in 'Android Devices' started by UBRocked, Oct 16, 2010.

?

Do you want the RRS to stay?

  1. Yes

    33 vote(s)
    78.6%
  2. No

    5 vote(s)
    11.9%
  3. I couldn't care less

    4 vote(s)
    9.5%
  1. UBRocked

    UBRocked VZW Nexus Please!!!
    VIP Member
    323

    Jan 31, 2010
    4,335
    1,563
    323
    Ohio
    Hello all,

    Looking to get some feedback and see if the ROM Rating System is still viable and whether or not it is actually proving useful for you?

    If there are things you would change...post them here. If we keep the RRS, we will need to recruit more ROM Revs as most of the original "staff" has left the party.

    Thoughts???
     

    Advertisement
    YankeeDudeL likes this.
  2. kujayhawks77

    kujayhawks77 Well-Known Member
    38

    Aug 23, 2010
    142
    13
    38
    Conroe, TX
    I'll have to put some thought into this. As a noob when I was first starting I did find it somewhat helpful but now (as a somewhat experienced noob :) ) I tend to notice that the majority of Roms are getting 4 and 5 ratings with a few ratings below 4. Of course I believe the roms have also improved drastically over time.

    Perhaps a revamping of the system is in order. Although I am not sure how this would actually be put in place. I'll give some thought before I vote.
     
  3. breadnatty08

    breadnatty08 pain rustique
    VIP Member
    1,313

    Nov 8, 2009
    19,890
    6,118
    1,313
    District of Columbia
    Yeah, I agree with a lot of what Kujayhawks says. Most ROMs out there average 60-68% 5 star. However, most of the posts are folks asking "What's the battery life like?", "Does it run hot?", "How smooth/fluid/fast/laggy is it?", "Does Wifi/GPS/Market/Bluetooth etc work?". So I think it's starting to negate the usefullness of the rating system as it currently is.
    My two cents..
     
  4. kratos

    kratos Back on my throne!!!
    VIP Member
    183

    Mar 2, 2010
    1,678
    430
    183
    Worldwide Logistics by day,Website design by night
    Olympus, Back on the throne!!!
    As you have stated, there is just not enough staff to keep up with the ROMs. I like the concept and really enjoy reading the reviews before I flash a new ROM. However, as of recently, the reviews haven't been getting done in a timely fashion and therefore negate the purpose of the RRS.

    Just my two cents.

    Kratos
     
  5. I think one thing that kind of needs to be taken into considertion, or more so stop being considered is past versions of roms. compare all current versions of a rom. Sure a certain rom may be a huge upgrade from its previous version but if its previous version sucks compared to all the others it shouldnt get a better rating. so it should stay but needs a revamp

    Best example I can think of would be bugless beast, although its my ROM of choice I don't think it is a 5star rom. id give it a 3.5 where as UD 8 would get a 4.5 star. my reason being that ud 8 is very stable has more features and is faster. BB is stable sure but it doesnt really bring anything to the table.

    im sorry if this is confusing my brain isn't functioning and I cant really think how to explain what my brain is thinking
     
  6. androidlover14

    androidlover14 Well-Known Member
    43

    Jun 28, 2010
    325
    26
    43
    Orlando, FL
    Well I also think a revamping is in need. Most of us more experienced root users don't really need it but less experienced ones do as they need guidance. Just like a growing child or something would need. I also would like to take you up on your offer on rom reviewing as I really switch roms to the newest thing anyways.
     
  7. UBRocked

    UBRocked VZW Nexus Please!!!
    VIP Member
    323

    Jan 31, 2010
    4,335
    1,563
    323
    Ohio
    Thanks for the info posted as well as the votes received thus far. I'm looking at ways we could revamp they system and as I am moving on to a new device soon...I'm looking to leave this program in the hands of some other capable guide or Mod...Hint Hint Kratos! LOL ;)

    Taking all advice at this time...so voice your thoughts. There are no dumb ideas here...and NO criticizing of other's ideas please...lets' get this system working the best we can so it can help those who need it.
     
  8. kratos

    kratos Back on my throne!!!
    VIP Member
    183

    Mar 2, 2010
    1,678
    430
    183
    Worldwide Logistics by day,Website design by night
    Olympus, Back on the throne!!!
    Sure call me out... LOL :p:p:p My, you sure do have a lot of faith in me... LOL :D:D:D;););)

    I would be honored to head up this program (or at least help head it up). I've been thinking of some ways to revamp it and the first thing I can think of is that we really need to get more reviewers (though that's not really much of a revamp as it is just a need). I'll keep thinking of things and keep you informed of what I come up with.

    I would like to hear more of what the community of review readers think about this. I think that input from the people who are reading the reviews will help us revamp the system in a way that helps them the most.

    Kratos
     
    SoDroid and UBRocked like this.
  9. androidlover14

    androidlover14 Well-Known Member
    43

    Jun 28, 2010
    325
    26
    43
    Orlando, FL
    Just wondering of what it takes to get to guide or mod status on this forum? And I think as a suggestion we can add categories to the reviews. As in as part of the review the reviewer would put the rom as a rom for someone who wants speed, stability, performance, features, etc.
     
  10. One thing I could think of that would kind of help would be categories as already mentioned, have a speed section, battery life, stability, features, all around. and categorize the roms through there. Only issue with this would be the fact that not all droids are the same, and the experiences wouldnt be the same, which a lot of people new to roms wont know.

    also I would like to throw it out there that I would be more than willing to help with this if needed I have 3 different droids with which to test roms on (soo nto be two though since im switching to the fascinate as my main phone)
     
  11. messenger13

    messenger13 Well-Known Member
    163

    Dec 8, 2009
    3,133
    381
    163
    Director of IT
    Cleveland, OH
    Just my opinion, but I don't value the rating system at all. We all know by now that how one ROM behaves on your DROID doesn't mean anything to my DROID. So why should I care if anyone gives a ROM 1 star, 3, or 5?
     
  12. johnlgalt

    johnlgalt Antidisestablishmentarian
    VIP Member
    333

    Oct 28, 2009
    9,416
    1,921
    333
    Male
    Graduate Research Assitant | That part time IT guy
    3rd Rock
    Believe it or not, Joe, that was one of the things I mentioned when it first came to fruition....

    But performance on individual DROIDs is but one aspect of the ROM, there is also installation, usability, tweaks, etc....
     
  13. OMJ

    OMJ Bazinga
    VIP Member
    213

    Nov 27, 2009
    3,290
    825
    213
    Finance
    Pennsylvania
    Its been awhile since I was actively helping out with RRS but I think the best solution may be to keep doing the polls but do away with the reviewers. I just took a quick glance but it doesnt seem many reviews have been done recently and I think more people pay attention to the polls than the reviews anyway.
     
  14. Papadroid

    Papadroid VIP Member
    VIP Member
    173

    Jan 21, 2010
    1,139
    281
    173
    Tampa, FL
    One thing I don't like about the rating system is that you don't get the score until after a newer version comes out so how is the score really helping? Why not put the score after a few days and update it every couple of days like current score as of x/x/xx.
     
  15. would there be a way to get multiple polls per rom? so have a battery life 1-5 poll a speed 1-5 poll features/themes 1-5poll and stability 1-5?
     
    SoDroid likes this.
  16. OMJ

    OMJ Bazinga
    VIP Member
    213

    Nov 27, 2009
    3,290
    825
    213
    Finance
    Pennsylvania
    nope only 1 poll per thread
     
  17. k00ey

    k00ey Well-Known Member
    16

    Jul 3, 2010
    80
    5
    16

    I have to agree with keeping the polls. I for one actually do check out the poll results for the roms before I make a choice as I don't have time to try out every single rom that I would like to I usually make my decisions by the poll rating and reading user feedback/reviews

    The reviews don't get put most likely because, like me, the reviewers don't have the time to try out every new rom that comes out. Our best option is to probably hope that the people who DO try out these roms put reviews of their own
     
  18. kratos

    kratos Back on my throne!!!
    VIP Member
    183

    Mar 2, 2010
    1,678
    430
    183
    Worldwide Logistics by day,Website design by night
    Olympus, Back on the throne!!!
    I can't help but wonder if we have lost so many reviewers because of attacks on them. I have seen a couple reviewers get attacked because people didn't agree with the reviewers opinions on the ROM.

    Kratos
     
  19. YankeeDudeL

    YankeeDudeL Well-Known Member
    213

    Oct 25, 2009
    2,170
    516
    213
    Male
    Wireless Sales Manager
    They can attack all they want, it's not gonna stop me. I fear no fanboy.

    I guess some of the other Revs were throwing around 4s and 5s like candy, but I don't think anyone could say that about me. It's tough to be so critical when these Devs are doing this on their own time for nothing but the inconsistency of a donation. I had to be, though, to properly convey my opinions on how ROMs fared against the other. And there was def a need with so many to choose from.

    I had a busy week, so I didn't get to do a review (that and I'm truly loving LFYv1.71). But I don't think anyone could say I haven't pulled my weight. We def need more Revs, though, if this system is to continue. They need to see how people's Droid respond to diff ROMs. Not to mention when one of us has a busy week where they can't make too many reviews, that the others will be there to pick up the slack.

    People should know that RRS had 15 ROM Revs and the goal was to get 3-5 reviews for each ROM.
     
  20. YankeeDudeL

    YankeeDudeL Well-Known Member
    213

    Oct 25, 2009
    2,170
    516
    213
    Male
    Wireless Sales Manager
    There were def some ill with me for previous versions of LFY, but when I did the review for BB, my lord, I thought the Spartan army was coming for me. That won't stop me from making an honest review, though.

    I think some of those who were so vocal about it be asked to be ROM Revs.
     
  21. kratos

    kratos Back on my throne!!!
    VIP Member
    183

    Mar 2, 2010
    1,678
    430
    183
    Worldwide Logistics by day,Website design by night
    Olympus, Back on the throne!!!
    Not my Spartan Army! LOL..

    I have a deep respect for true critics because they put up with all the back lashes when they make honest statements. I do appreciate you hard work with this and your review of BB is what made me wait on flashing it right away. I am glad I did wait because shortly after I had downloaded it, there was a large number of "bugs" being reported that required update.zip fixes.

    Anyways, I am starting to wonder how many Rev's we can actually recruit this time?

    Kratos
     
    YankeeDudeL likes this.
  22. YankeeDudeL

    YankeeDudeL Well-Known Member
    213

    Oct 25, 2009
    2,170
    516
    213
    Male
    Wireless Sales Manager
    There's some pretty active members on this site that I see on multiple ROM threads, so hopefully more will be willing to do so. I hated being the only face people would see. It's just not accurate enough to get a review from only one guy's Droid. Especially when that person tends to nitpick. :cool:
     
  23. SoDroid

    SoDroid Well-Known Member
    53

    Dec 17, 2009
    382
    76
    53
    Denver
    I like this idea. After reading Messenger's post about how he doesn't base his flashing decision at all on any review, I realized that I do the same, for the most part. With exception to Yankee's review of BB 0.5, I flash roms based on the dev, not really reviews. (Don't worry Yankee, I didn't want to flash it anyway :D)

    I would however, view category polls. It would include a large number of opinions creating a more accurate picture of how the rom 'may' perform, and it would be a very quick reference, as opposed to reading a 5-6 paragraph review. The sheer volume of data that we would have with category polls would have to make them somewhat accurate. Sure just because a certain rom performed well my droid does not mean it will perform well on yours. But if it performed well on 75 out of 100 Droids, well that is a meaningful statistic.
     
  24. snt

    snt Member
    16

    Mar 15, 2010
    20
    2
    16
    Exactly right. I have read countless times about how a particular ROM doesn't work so well for some users, but for others, it is the best they have ever used. Given this, I do not see much value.

    -SNT
     
  25. YankeeDudeL

    YankeeDudeL Well-Known Member
    213

    Oct 25, 2009
    2,170
    516
    213
    Male
    Wireless Sales Manager
    This is why 15 ROM Revs were chosen with a goal of 3-5 reviews per ROM. But in any case, you can get an idea of the functionality of the ROM, and if there are any common bugs and/or fixes.
     

Share This Page

Loading...