MAIN FORUM

Comments

  • JustinAtFanduel

    Fanduel Rep

    Lineup display issue and resolution

    Hi all,

    First, our apologies in taking so long to post a response but we wanted to ensure we had all the facts and the issue was researched appropriately before putting out a statement.

    Here’s a brief update on last night’s issues. We have a team working on both aspects of this:
    1. Making sure that we settle contests in a way that none of condia’s opponents feel that they’ve been adversely effected by the contest results. This may take several more hours.
    2. Making sure that this can’t happen again.

    In the meantime, here’s a detailed technical explanation of what happened. Feel free to ask questions about it, but please understand that our focus right now is on getting the issue fixed so we may not get to answer follow up questions today.
    The way our system works is that we have a main database which holds all the entries and updates a user has made to their lineups. This is updated directly when a user makes changes, and is used by the settlement system to determine outcomes of the contest. We always take the content of this database as definitive. According to this database, condia made changes to all his teams comfortably before the start of the games.

    In order to be able to display all the pages on the site quickly to our volume of users we run several copies of this database – these are kept up to date from the main database using standard replication techniques. These generally reflect updates to the main database within a second, although they do occasionally run slightly later than that.

    Live scoring is a more complex issue – calculating and displaying positions in tables on a large volume of data within a couple of seconds of getting an update can’t really be done if you need to get the data from a database every time. What we do for this is store all the table information in memory on another system (something between a copy of the database and a cache). This is fed continuously with updates from one of the copy databases – basically the live scoring system hits up the database every few seconds, and gets all changes with a timestamp later than the timestamp of the last change it processed, plus a 10 second grace period before that to catch anything that happened out of order.

    Growth in the size of the database over the season reached a point over Christmas where the copy database that the live scoring system gets its data from is only just keeping up, and large changes like an export from condia can tip it over into being more than 20 seconds out of date for a minute or two. This appears to have led to condia’s updates not making it through to the live scoring system.

    Since before the game the rosters that you can see as a user are delivered from the database, condia would have had no reason to be concerned – all his changes were showing correctly. Once the games started however the lineup he was seeing changed back to the earlier lineup. When the technical team became aware of the issue some time later, they restarted the live scoring system, which causes it to do a complete reload of data from the database. At this point, all of condia’s line-ups changed to reflect the changes which had been made hours before and not picked up.

    We are making some changes today to stop this happening – firstly we are increasing the size of the database servers so they will be able to stay comfortably on top of the load, and secondly we are increasing the grace period, so if things do start to run slowly we will still pick up all changes.

  • dhersh1968

    I would like to see a timeline as to the events and when they occurred. I work in IT and understand the technical explanation given. When something goes major wrong at my company we perform a detailed “root cause analysis” and publish it for all impacted parties to be able to review as in my industry there are regulations and significant failures have to be documented in this manner. I’d expect FD to also act in this manner, especially since actual money is at stake. The key to gaining and keeping trust is communication and IMO FD has failed in that regard. Every action taken last night and Friday night should have come with communication. The simple lack of communication becomes a red flag.

    Here is what I am most curious about time wise

    “When the technical team became aware of the issue some time later, they restarted the live scoring system, which causes it to do a complete reload of data from the database. At this point, all of condia’s line-ups changed to reflect the changes which had been made hours before and not picked up.”

    No time was given when this occurred relative to nightly contests. In reading post from people that have credibility it seems to have been up to 90 mins from contest starting.

    I know my play is small potatoes but I will withdraw and not play at FD until I am satisfied.

  • thefantasyman

    Hi All,

    We just wanted to update this thread now with a resolution. Last night we held settlement while our technical team investigated. Settlement has now run and all payouts are complete.

    The issue was that some users saw Condia’s lineup change after games had started. Specifically, it appeared as if Jack was replaced with Dragic and Duncan was replaced with Gibson. Rest assured this was not a late edit, but rather an issue with our live scoring system not showing an edit that was made close to game start due to technical issues (complete explanation at the top of the thread).

    We understand this looks concerning, however this was purely a display issue and our system never, under any circumstances, allows an edit to be made once games have started.

    Condia’s pre-edit lineup scored a total of 346.4. The updated lineup, again, submitted before game start, scored 347.5, a difference of 1.1 points. To compensate the small number of users who would have won based on the rosters they were seeing on screen, we are paying those players as if they won.

    We have taken technical steps to ensure this will not happen again. Please accept our apologies for the inconvenience and confusion this has caused.

  • Putz

    Close thread!

  • sethayates

    @Putz said…

    Close thread!

    Putz. We’re notgonnastop!

  • JSwizzle88

    @sethayates said…

    Putz. We’re notgonnastop!

    Notgonnastop!

  • bubblegumga

    *delete my post please

  • Fantacfreak

    fanduel..says u guys paid..i still haven’t been paid..

  • uncleslim

    @thefantasyman said…

    Hi All,

    We just wanted to update this thread now with a resolution. Last night we held settlement while our technical team investigated. Settlement has now run and all payouts are complete.

    The issue was that some users saw Condia’s lineup change after games had started. Specifically, it appeared as if Jack was replaced with Dragic and Duncan was replaced with Gibson. Rest assured this was not a late edit, but rather an issue with our live scoring system not showing an edit that was made close to game start due to technical issues (complete explanation at the top of the thread).

    We understand this looks concerning, however this was purely a display issue and our system never, under any circumstances, allows an edit to be made once games have started.

    Condia’s pre-edit lineup scored a total of 346.4. The updated lineup, again, submitted before game start, scored 347.5, a difference of 1.1 points. To compensate the small number of users who would have won based on the rosters they were seeing on screen, we are paying those players as if they won.

    We have taken technical steps to ensure this will not happen again. Please accept our apologies for the inconvenience and confusion this has caused.

    I haven’t gotten paid?

  • Jup13

    @thefantasyman said

    To compensate the small number of users who would have won based on the rosters they were seeing on screen, we are paying those players as if they won.

    So does this mean you will pay us automatically, or do we have to go through ALL of our contests manually to find them and present them to your support staff?

  • waiverwire

    Freak and slim – I’ve alerted the team. Are you referring to contests not settling or we’re you two of the people who finished close enough to condia that the adjustment would make you winners?

  • JChof

    So when do we get paid? I got banned from the chat for saying draft kings too many times. There’s no reason we shouldn’t have the money in the account already and I’m not redepositing to play today….screw that. By the time we do receive our money all the guaranteed tourneys will already be filled. Not fair to the customer.

  • thefantasyman

    @Jup13 said…

    So does this mean you will pay us automatically, or do we have to go through ALL of our contests manually to find them and present them to your support staff?

    Nope. Actually, my apologies as I might have jumped the gun here. We’re preparing settlement so it should be completed shortly.

    We will be auto paying out the correct winnings. No manual labor needed on your part ;) Those affected should see winnings momentarily.

  • uncleslim

    @waiverwire said…

    Freak and slim – I’ve alerted the team. Are you referring to contests not settling or we’re you two of the people who finished close enough to condia that the adjustment would make you winners?

    I stay away from condia if at all possible. I am referring to the contests not settling.

  • Putz

    @JSwizzle88 said…

    Notgonnastop!

    Haha!

  • thefantasyman

    @JChof said…

    So when do we get paid? I got banned from the chat for saying draft kings too many times. There’s no reason we shouldn’t have the money in the account already and I’m not redepositing to play today….screw that. By the time we do receive our money all the guaranteed tourneys will already be filled. Not fair to the customer.

    @JChof

    Sorry about that. Unfortunately, this is an issue we want to ensure is cleared up properly and that the settlement of winnings flows without an issue. We understand the frustration and apologize but we need to ensure settlement runs correctly. Should be done very soon.

  • Georgesteele

    I haven’t been paid yet either.

  • csuram88

    • 37

      RG Overall Ranking

    • Ranked #30

      RG Tiered Ranking

    • x7

      2014 DraftKings FFWC Finalist

    • 2014 DraftKings FBWC Champion

  • JChof

    @thefantasyman said…

    @JChof

    Sorry about that. Unfortunately, this is an issue we want to ensure is cleared up properly and that the settlement of winnings flows without an issue. We understand the frustration and apologize but we need to ensure settlement runs correctly. Should be done very soon.

    What is very soon….you told us noon first off and its currently 1:30 not all of us can sit at computer all day. When should i expect my money from last night to be in my account so I can try to register for some guaranteed tourneys before they are all closed due to the inconvenience of today….maybe you should open up guaranteed tourney for today for what has happened to everyone that played last night

  • waiverwire

    @csuram88 said…

    +1

    Settlement should be happening right now usually takes a few minutes to completed

  • merlik4

    That would make too much sense

  • Putz

    @JChof said…

    What is very soon….you told us noon first off and its currently 1:30 not all of us can sit at computer all day. When should i expect my money from last night to be in my account so I can try to register for some guaranteed tourneys before they are all closed due to the inconvenience of today….maybe you should open up guaranteed tourney for today for what has happened to everyone that played last night

    Go bitch about payment somewhere else please. Keep that in FD chat where it’s nonstop at 6AM Monday and Tuesday mornings.

  • DillingerFour

    FD Rep - DFBMeeMee Champ (x2)

    • Blogger of the Month

    Got paid.

    EVERYONE CALM DOWN NOW.

  • meluvhooters

    I see how this could happen… I remember when export first rolled out. If you went to edit a lu immediately after that lu was updated via export it would show the pre-exported lu.

  • waiverwire

    @meluvhooters said…

    I see how this could happen… I remember when export first rolled out. If you went to edit a lu immediately after that lu was updated via export it would show the pre-exported lu.

    Good memory. That’s what we thought happened to condia on Friday night. Unfortunately, we were wrong.

  • dean78904

    Grinders Live Host

    • 246

      RG Overall Ranking

    • Ranked #19

      RG Tiered Ranking

    • x2

      2017 CVR Baseball

    • x2

      2016 CVR Baseball

    100% Agree w/ Chop/STL. My FD H2H play would increase tenfold if match-up blocker were implemented.

    Also, while we’re submitting suggestions, would it be asking too much to be able to multi-enter contests? I know, now I’m just being silly and way too greedy.

  • X Unread Thread
  • X Thread with New Replies*
  • *Jumps to your first unread reply

Subforum Index

RotoGrinders.com is the home of the daily fantasy sports community. Our content, rankings, member blogs, promotions and forum discussion all cater to the players that like to create a new fantasy team every day of the week.

If you or someone you know has a gambling problem, crisis counseling and referral services can be accessed by calling 1-800-GAMBLER (1-800-426-2537) (IL). Gambling problem? Call 1-800-Gambler (NJ/WV/PA), 1-800-9-WITH-IT (IN), 1-800-522-4700 (CO) or 1-800-BETS OFF (IA). 21+. NJ/PA/WV/IN/IA/CO/IL only.