Sign Up

Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.

Have an account? Sign In

Have an account? Sign In Now

Sign In

Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.

Sign Up Here

Forgot Password?

Don't have account, Sign Up Here

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Have an account? Sign In Now

You must login to ask a question.

Forgot Password?

Need An Account, Sign Up Here

Please briefly explain why you feel this question should be reported.

Please briefly explain why you feel this answer should be reported.

Please briefly explain why you feel this user should be reported.

Sign InSign Up

WikiQuora

WikiQuora Logo WikiQuora Logo

WikiQuora Navigation

Search
Ask A Question

Mobile menu

Close
Ask A Question
  • Home
  • Add group
  • Feed
  • User Profile
  • Communities
  • Questions
  • Polls
  • Tags
  • Badges
  • Users
  • Help
Home/example

WikiQuora Latest Questions

W3spoint99
  • 0
W3spoint99Begginer
Asked: December 26, 2024In: Python

How to make good reproducible pandas examples?

  • 0

Having spent a decent amount of time watching both the r and pandas tags on SO, the impression that I get is that pandas questions are less likely to contain reproducible data. This is ...

examplehowpandaspython
  1. Saralyn
    Saralyn Teacher
    Added an answer on December 26, 2024 at 2:02 pm

    The Good: Do include a small example DataFrame, either as runnable code: In [1]: df = pd.DataFrame([[1, 2], [1, 3], [4, 6]], columns=['A', 'B']) or make it "copy and pasteable" using pd.read_clipboard(sep=r'\s\s+'). In [2]: df Out[2]: A B 0 1 2 1 1 3 2 4 6 Test it yourself to make sure it works andRead more

    The Good:

    • Do include a small example DataFrame, either as runnable code:
      In [1]: df = pd.DataFrame([[1, 2], [1, 3], [4, 6]], columns=['A', 'B'])
      

      or make it “copy and pasteable” using pd.read_clipboard(sep=r'\s\s+').

      In [2]: df
      Out[2]:
         A  B
      0  1  2
      1  1  3
      2  4  6
      

      Test it yourself to make sure it works and reproduces the issue.

      • You can format the text for Stack Overflow by highlighting and using Ctrl+K (or prepend four spaces to each line), or place three backticks (“`) above and below your code with your code unindented.
      • I really do mean small. The vast majority of example DataFrames could be fewer than 6 rows,[citation needed] and I bet I can do it in 5. Can you reproduce the error with df = df.head()? If not, fiddle around to see if you can make up a small DataFrame which exhibits the issue you are facing.

        But every rule has an exception, the obvious one being for performance issues (in which case definitely use %timeit and possibly %prun to profile your code), where you should generate:

        df = pd.DataFrame(np.random.randn(100000000, 10))
        

        Consider using np.random.seed so we have the exact same frame. Having said that, “make this code fast for me” is not strictly on topic for the site.

      • For getting runnable code, df.to_dict is often useful, with the different orient options for different cases. In the example above, I could have grabbed the data and columns from df.to_dict('split').
    • Write out the outcome you desire (similarly to above)
      In [3]: iwantthis
      Out[3]:
         A  B
      0  1  5
      1  4  6
      

      Explain where the numbers come from:

      The 5 is the sum of the B column for the rows where A is 1.

    • Do show the code you’ve tried:
      In [4]: df.groupby('A').sum()
      Out[4]:
         B
      A
      1  5
      4  6
      

      But say what’s incorrect:

      The A column is in the index rather than a column.

    • Do show you’ve done some research (search the documentation, search Stack Overflow), and give a summary:

      The docstring for sum simply states “Compute sum of group values”

      The groupby documentation doesn’t give any examples for this.

      Aside: the answer here is to use df.groupby('A', as_index=False).sum().

    • If it’s relevant that you have Timestamp columns, e.g. you’re resampling or something, then be explicit and apply pd.to_datetime to them for good measure.
      df['date'] = pd.to_datetime(df['date']) # this column ought to be date.
      

      Sometimes this is the issue itself: they were strings.

    The Bad:

    • Don’t include a MultiIndex, which we can’t copy and paste (see above). This is kind of a grievance with Pandas’ default display, but nonetheless annoying:
      In [11]: df
      Out[11]:
           C
      A B
      1 2  3
        2  6
      

      The correct way is to include an ordinary DataFrame with a set_index call:

      In [12]: df = pd.DataFrame([[1, 2, 3], [1, 2, 6]], columns=['A', 'B', 'C'])
      
      In [13]: df = df.set_index(['A', 'B'])
      
      In [14]: df
      Out[14]:
           C
      A B
      1 2  3
        2  6
      
    • Do provide insight to what it is when giving the outcome you want:
         B
      A
      1  1
      5  0
      

      Be specific about how you got the numbers (what are they)… double check they’re correct.

    • If your code throws an error, do include the entire stack trace. This can be edited out later if it’s too noisy. Show the line number and the corresponding line of your code which it’s raising against.
    • Pandas 2.0 introduced a number of changes, and Pandas 1.0 before that, so if you’re getting unexpected output, include the version:
      pd.__version__
      

      On that note, you might also want to include the version of Python, your OS, and any other libraries. You could use pd.show_versions() or the session_info package (which shows loaded libraries and Jupyter/IPython environment).

    The Ugly:

    • Don’t link to a CSV file we don’t have access to (and ideally don’t link to an external source at all).
      df = pd.read_csv('my_secret_file.csv') # ideally with lots of parsing options
      

      Most data is proprietary, we get that. Make up similar data and see if you can reproduce the problem (something small).

    • Don’t explain the situation vaguely in words, like you have a DataFrame which is “large”, mention some of the column names in passing (be sure not to mention their dtypes). Try and go into lots of detail about something which is completely meaningless without seeing the actual context. Presumably no one is even going to read to the end of this paragraph.

      Essays are bad; it’s easier with small examples.

    • Don’t include 10+ (100+??) lines of data munging before getting to your actual question.

      Please, we see enough of this in our day jobs. We want to help, but not like this…. Cut the intro, and just show the relevant DataFrames (or small versions of them) in the step which is causing you trouble.

    See less
      • 0
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
      • Report
1
  • 1 1 Answer
  • 555 Views
Answer

Sidebar

Ask A Question
  • Popular
  • Answers
  • W3spoint99

    What is the difference between Promises and Observables?

    • 2 Answers
  • W3spoint99

    Can't bind to 'ngModel' since it isn't a known property ...

    • 2 Answers
  • W3spoint99

    How to prevent SQL injection in PHP?

    • 1 Answer
  • Saralyn
    Saralyn added an answer Learn Java if: ✅ You want to work on enterprise applications.… April 27, 2025 at 2:01 pm
  • Saralyn
    Saralyn added an answer AI is getting smarter, but replacing programmers entirely? That’s not… April 27, 2025 at 1:58 pm
  • Saralyn
    Saralyn added an answer Both Promises and Observables provide us with abstractions that help us deal with the asynchronous nature… January 17, 2025 at 2:03 pm

Trending Tags

AI angular application.properties arrays artificial intelligence coding how Java javascript machine learning mysql nullpointerexception php programmer python reactjs spring springboot sql string

Explore

  • Home
  • Add group
  • Groups page
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Users
  • Help

Footer

  • About US
  • Privacy Policy
  • Questions
  • Recent Questions
  • Web Stories

© 2025 WikiQuora.Com. All Rights Reserved