AN OPEN LETTER FROM FORGEHUB REGARDING THE 2V2 CONTEST

Discussion in 'Announcements' started by WAR, May 26, 2016.

By WAR on May 26, 2016 at 11:29 AM
  1. WAR

    WAR Cartographer
    The Creator Forge Critic

    Messages:
    1,568
    Likes Received:
    3,893
    AN OPEN LETTER FROM FORGEHUB REGARDING THE 2V2 CONTEST

    As the owner of ForgeHub and the creator of the 2v2 Throwdown Map Contest, I'd like to apologize for the recent events that have come to our attention regarding the perceived mis-management of this contest and would like to address all of the concerns raised with as much transparency as possible.


    WHAT HAPPENED?
    During testing for the 2v2 Throwdown Map Contest, improper testing conditions were applied to the map 'Orxgens', which was forged and submitted by thefro3po. As will be shown later in the article, this was totally unintentional. The judging panel had every intention of applying fair and equal testing conditions to all of the maps that were entered into the contest. Unfortunately, in the case of Orxgens, the version of the map that was tested had been updated after the submission deadline.


    HOW DID THIS HAPPEN?
    Once the submission deadline had passed, all of the submitted maps were saved via 'bookmarks', which meant that updates could be applied to a map file after it had been saved. Furthermore, if a bookmarked map file was deleted by the forger, the bookmark would be rendered 'Invalid'. With no intention of wrongdoing, the combination of these circumstances lead us into our current predicament.


    WHY DIDN'T WE SAVE THE MAPS LOCALLY?
    - With 145 map submissions and 100 local storage slots, we were unable to 'locally' save all of maps onto a single profile.
    - The convenience of being able to 'bookmark' all 145 maps onto a single profile seemed more attractive from a logistical perspective, as saving maps locally would have added a considerable amount of time to the process.

    Despite reasoning that seemed logical at the time, we recognize that this was a poor decision.
    All of the issues we encountered would have been prevented if we had properly saved all of the map files 'locally'. For this, we are deeply sorry. This will not happen again in future contests.


    WAS 'ORXGENS' MODIFIED PAST THE SUBMISSION DEADLINE?
    Yes, Orxgens was modified after the submission deadline.
    Without any intention of wrongdoing, the map used during testing was modified past the submission deadline by the original author. Due to maps being saved via 'bookmarks', all updates applied by the author automatically transferred over to the version we collected. The author updated the map after the deadline in an attempt to address feedback that was posted on his map page which, you can read below.

    Before the Submission Deadline (Midnight of March 1st)

    The following feedback was posted on the Map Thread for Orxgens:
    "I fixed your lighting issues to an extent" - purely fat (March 1)
    "I think you should take the Railgun off a weapon pad and drop spawn it. That many shots is going to break the map in Doubles. I'd also suggest you reduce the amount of lights on your map because you have framerate drops, most noticeably in the space area." - A 3 Legged Goat (March 1)​

    After the Submission Deadline

    The following changes were made to the map by the author, and addressed within the Map Thread:
    "I ended up changing the Rail to three shots, I don't like taking the weapons off of the pads, but not being able to change the amount of ammo is quite the downfall for sure" - thefro3po (March 2)
    "Just deleted a massive amount of lights and re-positioned others." - thefro3po (March 5)​


    WAS THERE EVER A VERSION OF ORXGENS PLAYED THAT WAS MODIFIED BY THE JUDGES?
    Yes. Please read on for the explanation.

    The version of the map that was used during contest testing all the way until the finalists (Top 5) had been solidified was NOT modified by the judges. All modifications and alterations were made by the original author of the map. We've searched through Game History on Waypoint to verify this.

    March 2nd (the day after the submission deadline)
    - There was an unofficial playtest on Orxgens (Waypoint Link). Note that if you look at the top left corner of the map image, it says 'PARALLAX'. As will become evident with the subsequent links, maps show up this way after they've been deleted by the original author.

    March 7th
    - First judging session occurs (Unfortunately, for some reason the Game History on Waypoint is unavailable for a stretch of days in March (Exhibit A, Exhibit B, Exhibit C, Exhibit D), so there's no record of our first official judging session for Orxgens.

    More Tests on Orxgens
    March 18th - Waypoint Link
    March 24th - Waypoint Link
    March 25th - Waypoint Link
    March 27th - Waypoint Link
    March 28th - Waypoint Link
    March 29th - Waypoint Link
    March 30th - Waypoint Link

    As can be seen by looking at the top left corner of the map picture in each link, the map being used was last updated by thefro3po. The judges did not make any alterations to the map during contest testing. Testing concluded when we reached a top 5 decision on March 30th. One more note regarding this - click This Link for proof that the Game History shows the last person to modify a map as the author (Matclan shows as the author of this map, which was originally forged by Shifty).


    BUT I THOUGHT YOU SAID THE JUDGES PLAYED ON A VERSION OF THE MAP THEY HAD MODIFIED?
    After Orxgens reached a finalist position (Top 5), I was responsible for preparing maps for the 2v2 playlist. We made an alternate version of the map with the Camo and OS placed on Weapon Pads, and found that it played better with those adjustments. I handed in the final selection of maps to 343 with the adjustment I noted above shortly afterwards.

    I had to make adjustments to all of the 2v2 maps to properly hand them off to 343. Maps that go in matchmaking must undergo a series of refinement checks to ensure that the general population will have the best experience possible. That requires a full inspection of the map including other changes such as player containment, name location volumes, decals and other aesthetic touches for player orientation. The changes made to the 2v2 maps in no way impacted their placement in the Throwdown Map Contest.​


    March 1
    - map submissions due midnight
    - Goat recommended to update lighting and railgun (dropspawn) fro3po's map page
    - Match with aPK and Warholic (midnight) - Orxgens (unofficial playtest, not all judges present)

    March 2
    - Chunk bookmarks all 2v2 maps
    - Railgun changed on map by author

    March 5
    - Lighting updated on map by author

    March 7
    - First judging session occurs

    March 30
    - Prepared 10 maps for matchmaking, fine tuning and other necessary adjustments made
    - Top 5 maps established
    - Alternative version of Orxgens with Weapon Pads tested - Waypoint Link

    March 31
    - Maps sent to 343 for playlist


    THE VERDICT
    Since the version of Orxgens used in testing sessions was modified by the author after the submission deadline, we have no choice but to disqualify it from the Map Contest. On behalf of all the judges, we wish to express our sincerest apologies to thefro3po for our failure to properly save your map. We're embarrassed and disappointed at our own lack of foresight, and deeply saddened by the fact that it's resulted in this disqualification.
     
    #1 WAR, May 26, 2016
    Last edited: May 26, 2016
Tags: this article has not been tagged

Comments

Discussion in 'Announcements' started by WAR, May 26, 2016.

    1. a Chunk
      a Chunk
      If I remember when I have more time, I can expand on this slightly, but for now I'll just say that every map competition we run that isn't specifically stated to be an aesthetic competition will be judged with a heavy focus on how well the map plays competitively. In this case, we assumed that would be obvious when we stated that the winning maps would be used in a tournament. I apologize for the confusion. It certainly wasn't intentional.
      Last edited: Jun 3, 2016
      Aschur, Jack Bell and Xandrith like this.
    2. Jack Bell
      Jack Bell
      I don't think it is your map that has people offended, it's these pity posts about "if you would have known"...
      The only reason I posted in response to you is because I have seen you complain about this in different threads now.

      Truly if you wanted to make another map for this contest you had plenty of time, no one Said you could only submit 'UNSC Jade Harbor'.

      I submitted 5 maps myself. So I know it can be done. But that is all I will say about that.

      Forge is about creativity and helping the community. Let's forget about this contest already and get back to that.

      Take care,
      Lotus

      PS. The intro camera on Jade Harbor is legit and I did go into forge the first time I saw it to see what unique pieces you used. It was like stepping into Alien the movie. Never played a match on it, too tight quarters for competitive Halo.
      Last edited: Jun 3, 2016
      Anemeros and SecretSchnitzel like this.
    3. Tom Cinder
      Tom Cinder
      I'll keep it simple: I like UNSC Jade Harbor, both aesthetically and "competitively."

      The reason for the quotation marks there is my distaste for the maps that are currently considered competitive by the halo community. I can't tell you how many times I load up a disc map or a forge feature and I think "Really?!? This looks so boring!"

      This is the humble opinion of a mediocre-at-best halo player and a yet-to-be-featured forger. Nevertheless, the vast majority of those playing and forging are in this boat with me.

      I'd prefer to see more content and contests posted with a typical player in mind, not someone that views Halo as a sport.

      I want a clean, no-frills basketball court, soccer field, running track, etc.,

      ...but give me a paintball course or a Halo map that's DIRTY. It should be a location first, an arena second.

      Halo and other FPS games simulate war, which is not fought in clean little arenas. We should be forging accordingly.

      Okay, whew. Rant over. I'm still appreciative of ForgeHub for hosting the contest. I'm sure there will be at least a couple maps I enjoy once the results are announced.

      Peace.
      Anemeros and Dunco like this.
    4. purely fat
      purely fat
      Because arena shooters simulate war. SMH That is just a bad take. Arena shooters are not Cod( I am excluding the new cods), BF, CS, etc. They do not simulate war in anyway. I know halo has moved away from it's roots but it is still closer to that than something that is supposed to be based off reality.

      So arena shooters should go away from what originally made them great that is the type of thinking that ruins a franchise. Wait it already did, thanks 343.
      AnonomissX and MultiLockOn like this.
    5. purely fat
      purely fat
      So the next halo will have the ability to hide behind cover and you will mover slower than a turtle. Because that is what the average player wants I guess. Not Halo. This is the type of thinking that ****ing poisons games and causes them to lose their fanbase. Let's make every game muddy as possible trying to please everyone and have it just end up being ****.

      The example at the top is the only way the maps you are describing would ever work in a non ads shooter. I am sick of opinions like this. These types of opinions are the reason halo is basically dead and Microsoft has to throw crazy money at it to get people consider it.

      I am triggered beyond repair right now.
      Given To Fly and MultiLockOn like this.
    6. Tom Cinder
      Tom Cinder
      We disagree.

    7. purely fat
      purely fat
      Well there is nothing to disagree on because you just don't get it. That simple. You are the rot that comes to every gaming community at some point or another and unfortunately the rot became the masses in halo. You could have at least tried but the rot never tries. All they do is hope the site has strict policy about banning people so they can get those that are disgruntled by causing them to rage. They then replace them as the majority. If this were any other site I would be banned for this. The only way people get banned here though is by posting too many links to porn sites. You guys do realize like anything it is about making your customer happy. The customer here were the judges. The customer in comp. are the pros. When 343 listens to the average gamer, who are usually trash at everything they play, we get Halo 4 also known as The Worst Halo of all Time.

      I'm done. Back to just posting in the Overwatch thread. I hate all of you. Just kidding, only some of you.
    8. Tom Cinder
      Tom Cinder
      You make a lot of assumptions about strangers.
    9. Given To Fly
      Given To Fly
      It's so refreshing to see somebody else triggered by ignorance. :popcorn:

      No really... I'm actually eating popcorn rn
    10. purely fat
      purely fat
      I make a lot of assumptions based off the only two posters who have taken this position on the subject and past experiences dealing with this sort of ****. I know this ****ing song and dance from both sides. I have had to fight for types of maps to get some love. You also have not defended your point. You have given me plenty to use as my basis of saying what I have said. Now are you going to defend your point? Do you have a defense? Are you going to continue to defer and avoid the points I made initially.

      **** man we are strangers to ourselves.

      Schnitzel could you keep your insults more PG-13.

      See you all Monday. Someone take over for me.
    11. a Chunk
      a Chunk
      Here are my feelings on judging criteria...(wall of text incoming)

      Unless it's explicitly stated that a map contest is focusing entirely on aesthetics or entirely on gameplay, there's not really much point in saying which will be more important, because ultimately a map will need to be strong in both areas to have any chance of placing near the top. In this particular contest, there were beautiful maps that were cut because their gameplay wasn't up to par, and there were maps that played very well which were cut because they weren't up to par aesthetically.


      I'm personally against laying out or following explicit grading criteria when it comes to judging. This is not an Olympic competition. I've always felt that when you dictate very specific criteria for judging forge contests, you do more harm than good. The maps submitted to a contest with strict criteria lack in variety and creativity, because the forgers (naturally) prioritize excelling in particular areas that will net them a higher rating.

      Strict criteria are equally harmful to the judging process. I know that there has been a long supported movement to remove personal bias from judging processes, and I have to admit that while I understand this perspective, I very strongly disagree with it. I think that any judge worth their salt should be able to recognize their biases, and look past them to be able to recognize a quality map even when it doesn't play or look the way THEY would want it to play or look (and I've personally seen judges do this many times). However, what's the point of having judges if you remove their personal perspective/opinion from the judging process. Their whole purpose of being in that position is to judge the maps.


      The only way to remove bias is to have an enormous amount of people actually grade each map. This isn't really a viable solution either though, because it then becomes nearly impossible to guarantee that the people voting have actually even downloaded the map, much less played on it. In a scenario like that you end up with results that are very watered down. This is essentially what happened when voting was allowed to determine which Breakout maps made it into matchmaking. There was very little separating the maps percentage wise, and I believe all but one map ended up making the cut as a result. In my opinion, the results of the voting absolutely did NOT reflect the quality of the maps.


      I view freedom of expression and freedom of interpretation as being extremely valuable when it comes to forge. Forging is a combination of science and art. When you try to take the art portion of the equation (which is the expression of imagination, and requires an individual perspective) and quantify it, you're unintentionally removing a great deal of what can make a map special.

      Obviously, allowing personal interpretation to play a part in a judging process means that the results will often be controversial. I'll gladly accept any backlash that results from it, because I truly believe it's the best approach.


      TLDR - Strict judging guidelines are counterproductive. When you provide strict guidelines and judge submissions with as little personal interpretation as possible, you get worse results.
      purely fat, WAR, theSpinCycle and 5 others like this.
    12. Tom Cinder
      Tom Cinder
      My apologies to the forum owners for accidentally inciting such a level of vitriol among some of your members less willing to communicate like mature adults.

      If not for the positive experiences I've had with this forum up until now, I would kindly remove myself from this corner of the Halo community as suggested. However, as I've observed at least one of these individuals belittling strangers on a regular basis, I'm not surprised that he eventually got around to me. I will respectfully not link him to my overall impression of ForgeHub.

      I lurk this site daily and I'm often very impressed with the posted content. My friends and I have enjoyed Halo 5 much more thanks to the efforts of this forum and its community.

      I've even enjoyed the content posted by those currently lashing out at me because we differ in opinion. I suspect we agree more than we disagree, but I may never know because I don't often see a mature, constructive debate being born from such disrespect and disregard for building community.
      --- Double Post Merged, Jun 3, 2016 ---
      Very well said, sir.
      WAR and Anemeros like this.
    13. SecretSchnitzel
      SecretSchnitzel
      I'm hardly belittling you, I'm having fun at you're expense.

      Edited by a Chunk
      MultiLockOn, Given To Fly and Dunco like this.
    14. Goat
      Goat
      I wouldn't say it's a humble opinion when you are also trying to dictate how maps "should" be Forged.

      Variety and variables are essential to keeping the game interesting, but "competitive" maps will all generally feel the same because that's how Halo is played at a high level.
      MultiLockOn likes this.
    15. Tom Cinder
      Tom Cinder
      Thanks for the reply. My apologies for not being more clear in my initial post. Perhaps I may clear this up:

      My intent was to suggest and encourage more recognition of variety in maps, not to dictate how any one forger should do his or her work.

      I find the clean-cut maps are certainly enjoyable for what they are, and I am confident that they will always be there.

      If my opinion that they are oversaturated is unpopular, I hold nothing against anyone who may disagree with me.

      I enjoy playing on maps that present unique challenges and provide experiences that may not be found in matchmaking. Therefore, I appreciate when maps like UNSC Jade Harbor are posted, and dislike them being belittled just because they don't fit a mold.
      Anemeros likes this.
    16. Goat
      Goat
      Again, I'm all for variables and a variety of creative ideas. That particular map just failed to meet the criteria we were looking for.

      It wasn't tournament worthy or matchmaking worthy because 1. it had major framerate issues and 2. it had exploitable geometry (small dance floor, rooms to hide in). It was a stunning map visually, and I wouldn't insinuate that the map wouldn't be fun to play. It just wouldn't have been a strong competitor as far as how Halo is actually played, wherein players tend to stress the map as much as possible to achieve victory.

      Some designs don't work when money is on the line and they don't work when people are trying to rank up or otherwise win the match. You'll have people camp in the rooms or crouch behind chokepoints that are difficult to contest, and it just wont play a very consistent match in a serious setting. But there's no law against maps with unique challenges or creative ideas. Some of them just don't have strong synergy and it holds the concept back.
      Last edited: Jun 3, 2016
    17. Tom Cinder
      Tom Cinder
      I find this perfectly reasonable. My post wasn't trying to argue that it should have done better in the contest or that the contest requirements weren't clear enough. I simply didn't like seeing it get so much undeserved flack.

      WAR and Goat like this.
    18. MultiLockOn
      MultiLockOn
      For the record. Whether something is oversaturated or popular has no bearing on its quality as a map. It doesn't matter how many midship clones we get because midship is one of the greatest Halo maps of all time and that formula will always hold true to that. Emulating a battlefield, as you put it, means **** bumpkiss to myself or any other level designer.

      Maps are here to perform a role, which is to give varied experiences within a set sandbox (the game mechanics). That's accomplished geometrically, not through art. If you think the map you choose should be over commended because of its setting, you're wrong. At least in relation to actual gameplay. You're free to enjoy the art side of making maps but at that point you might as well go paint something with water colours.
      Given To Fly likes this.
    19. AnonomissX
      AnonomissX
      Ok, fundamentals first, then interior design. You can start with one or the other, but a finished map needs to be both. Clear? Jeeez peeps!
    20. Tom Cinder
      Tom Cinder
      Ah, now this has potential to be a constructive debate. Thank you.

      Midship and its clones are a good example. Regret is my favorite one because of the aesthetic direction and therefore the increased immersion into the experience.

      I know many people may disagree with the following, and that is fine. It's been my opinion ever since we were given forge back in the day:

      No matter how well a map plays, if the aesthetics are weak and it takes too much effort for me to suspend my disbelief, I'm not likely to keep it bookmarked.

      A forged map should not look or feel like a forged map. Especially given the tools we have now. With each update we have less excuses.

      Maybe not everyone thinks about Regret being a "crashed-landed and deteriorated" Midship map every time it loads up, but I do, and that immersion is why I find it superior.

      purely fat, WAR and MultiLockOn like this.

Share This Page