Logarithm of dependent variable is uniformly distributed. How to calculate a confidence interval for the...





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}







4












$begingroup$


My dependent variable is extremely non-normally distributed (Shapiro-Wilk gives $p=0.004$). However, taking its logarithm gives me something freakishly close to a uniform distribution. When I plot the logarithm’s cumulative frequency it is an almost perfect straight line ($r=0.99$).



I want to calculate a confidence interval for the mean on the original scale. Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve? Shapiro-Wilk is rejecting $mathrm{H}_0$, telling me it’s not normally distributed, however for all intents and purposes it has no skewness.



If not, then what can I use to get a confidence interval?



EDIT: For what it’s worth:



There are 24 data points in the sample.



I had originally planned to compare the variable in question with some other independent variables, however exploratory data analysis found absolutely no correlation between them.



I was thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.










share|cite|improve this question











$endgroup$














  • $begingroup$
    How large is the sample?
    $endgroup$
    – Glen_b
    May 26 at 7:04










  • $begingroup$
    24 data points.
    $endgroup$
    – Alex Tully
    May 26 at 7:06










  • $begingroup$
    And the mean you want the CI for is the original (untransformed) population?
    $endgroup$
    – Glen_b
    May 26 at 7:06










  • $begingroup$
    Yes it is thanks.
    $endgroup$
    – Alex Tully
    May 26 at 7:07










  • $begingroup$
    I wast thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.
    $endgroup$
    – Alex Tully
    May 26 at 7:11


















4












$begingroup$


My dependent variable is extremely non-normally distributed (Shapiro-Wilk gives $p=0.004$). However, taking its logarithm gives me something freakishly close to a uniform distribution. When I plot the logarithm’s cumulative frequency it is an almost perfect straight line ($r=0.99$).



I want to calculate a confidence interval for the mean on the original scale. Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve? Shapiro-Wilk is rejecting $mathrm{H}_0$, telling me it’s not normally distributed, however for all intents and purposes it has no skewness.



If not, then what can I use to get a confidence interval?



EDIT: For what it’s worth:



There are 24 data points in the sample.



I had originally planned to compare the variable in question with some other independent variables, however exploratory data analysis found absolutely no correlation between them.



I was thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.










share|cite|improve this question











$endgroup$














  • $begingroup$
    How large is the sample?
    $endgroup$
    – Glen_b
    May 26 at 7:04










  • $begingroup$
    24 data points.
    $endgroup$
    – Alex Tully
    May 26 at 7:06










  • $begingroup$
    And the mean you want the CI for is the original (untransformed) population?
    $endgroup$
    – Glen_b
    May 26 at 7:06










  • $begingroup$
    Yes it is thanks.
    $endgroup$
    – Alex Tully
    May 26 at 7:07










  • $begingroup$
    I wast thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.
    $endgroup$
    – Alex Tully
    May 26 at 7:11














4












4








4


1



$begingroup$


My dependent variable is extremely non-normally distributed (Shapiro-Wilk gives $p=0.004$). However, taking its logarithm gives me something freakishly close to a uniform distribution. When I plot the logarithm’s cumulative frequency it is an almost perfect straight line ($r=0.99$).



I want to calculate a confidence interval for the mean on the original scale. Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve? Shapiro-Wilk is rejecting $mathrm{H}_0$, telling me it’s not normally distributed, however for all intents and purposes it has no skewness.



If not, then what can I use to get a confidence interval?



EDIT: For what it’s worth:



There are 24 data points in the sample.



I had originally planned to compare the variable in question with some other independent variables, however exploratory data analysis found absolutely no correlation between them.



I was thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.










share|cite|improve this question











$endgroup$




My dependent variable is extremely non-normally distributed (Shapiro-Wilk gives $p=0.004$). However, taking its logarithm gives me something freakishly close to a uniform distribution. When I plot the logarithm’s cumulative frequency it is an almost perfect straight line ($r=0.99$).



I want to calculate a confidence interval for the mean on the original scale. Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve? Shapiro-Wilk is rejecting $mathrm{H}_0$, telling me it’s not normally distributed, however for all intents and purposes it has no skewness.



If not, then what can I use to get a confidence interval?



EDIT: For what it’s worth:



There are 24 data points in the sample.



I had originally planned to compare the variable in question with some other independent variables, however exploratory data analysis found absolutely no correlation between them.



I was thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.







confidence-interval mean normality-assumption lognormal






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited May 26 at 7:45







Alex Tully

















asked May 26 at 6:56









Alex TullyAlex Tully

213 bronze badges




213 bronze badges















  • $begingroup$
    How large is the sample?
    $endgroup$
    – Glen_b
    May 26 at 7:04










  • $begingroup$
    24 data points.
    $endgroup$
    – Alex Tully
    May 26 at 7:06










  • $begingroup$
    And the mean you want the CI for is the original (untransformed) population?
    $endgroup$
    – Glen_b
    May 26 at 7:06










  • $begingroup$
    Yes it is thanks.
    $endgroup$
    – Alex Tully
    May 26 at 7:07










  • $begingroup$
    I wast thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.
    $endgroup$
    – Alex Tully
    May 26 at 7:11


















  • $begingroup$
    How large is the sample?
    $endgroup$
    – Glen_b
    May 26 at 7:04










  • $begingroup$
    24 data points.
    $endgroup$
    – Alex Tully
    May 26 at 7:06










  • $begingroup$
    And the mean you want the CI for is the original (untransformed) population?
    $endgroup$
    – Glen_b
    May 26 at 7:06










  • $begingroup$
    Yes it is thanks.
    $endgroup$
    – Alex Tully
    May 26 at 7:07










  • $begingroup$
    I wast thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.
    $endgroup$
    – Alex Tully
    May 26 at 7:11
















$begingroup$
How large is the sample?
$endgroup$
– Glen_b
May 26 at 7:04




$begingroup$
How large is the sample?
$endgroup$
– Glen_b
May 26 at 7:04












$begingroup$
24 data points.
$endgroup$
– Alex Tully
May 26 at 7:06




$begingroup$
24 data points.
$endgroup$
– Alex Tully
May 26 at 7:06












$begingroup$
And the mean you want the CI for is the original (untransformed) population?
$endgroup$
– Glen_b
May 26 at 7:06




$begingroup$
And the mean you want the CI for is the original (untransformed) population?
$endgroup$
– Glen_b
May 26 at 7:06












$begingroup$
Yes it is thanks.
$endgroup$
– Alex Tully
May 26 at 7:07




$begingroup$
Yes it is thanks.
$endgroup$
– Alex Tully
May 26 at 7:07












$begingroup$
I wast thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.
$endgroup$
– Alex Tully
May 26 at 7:11




$begingroup$
I wast thinking about using the modified Cox formula described here tandfonline.com/doi/pdf/10.1080/10691898.2005.11910638, but I’m not sure whether it’s valid in the case of data that is clearly log-uniformly distributed.
$endgroup$
– Alex Tully
May 26 at 7:11










3 Answers
3






active

oldest

votes


















4












$begingroup$


Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve?




No, in this case you are dealing with a variable that is log-uniform distributed.



One approach is to use the bootstrap, where you takes samples repeatedly with replacement and compute the means of the samples.



See the answers to this question, which deals with log-normal data, but the principles are the same:



How do I calculate a confidence interval for the mean of a log-normal data set?






share|cite|improve this answer









$endgroup$























    4












    $begingroup$

    In regression problems the marginal distribution of Y does not matter. The conditional distribution of Y | X is what matters. For some problems this translates to examining the distribution of the model residuals.



    But your sample size is too small to check assumptions. It would be far better to use a robust approach that has many fewer assumptions, e.g.




    1. If you have one X and want to quantify the strength of relationship between X and Y, use a rank correlation coefficient

    2. Use a semiparametric regression model such as the proportional odds model that makes no assumption about the distribution of Y | X but only makes assumptions about the relative shapes of conditional distributions across different value of X. This generalizes rank correlation and Wilcoxon-type methods.

    3. Use a Bayesian model that generalizes the usual models, e.g., that has a prior distribution for the degree of non-normality or non-constant variance of conditional distributions.

    4. Use the bootstrap as advised above, but be cautious because the bootstrap is only approximate.






    share|cite|improve this answer









    $endgroup$











    • 1




      $begingroup$
      Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
      $endgroup$
      – Glen_b
      May 26 at 22:14








    • 1




      $begingroup$
      One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
      $endgroup$
      – Frank Harrell
      May 26 at 22:22



















    3












    $begingroup$

    Something whose log would be close to uniform is somewhat skew, but not particularly difficult to deal with; sample means of size 24 will be very close to normally distributed.



    If it were actually log-uniform we could work out a suitable interval fairly readily but I wouldn't actually use the fact that the sample looks like its log is uniform; with only 24 observations that judgement may be rather suspect and you certainly don't want to be doing such model selection/identification on the very sample you're using for inference, since you don't have a good way of accounting for the effect of that (e.g. it will tend to make intervals narrower than they should be but quantifying how much is rather tricky). If they were actually log-uniform those narrower intervals would be "honestly" narrow, but there's no good basis to say so.



    Simulation at n=24 suggests that a 95% two-tailed t-interval on the untransformed data should perform reasonably well (i.e. give coverage very close to 95%) for data something similar to this, even though this is not actually normal and the distribution of sample means is slightly skew. If you want to go far into the tails it may be more of an issue, but a 95% two-sided interval should be fine.






    share|cite|improve this answer











    $endgroup$















    • $begingroup$
      Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
      $endgroup$
      – Frank Harrell
      May 26 at 11:14






    • 1




      $begingroup$
      Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
      $endgroup$
      – Glen_b
      May 26 at 22:02
















    Your Answer








    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "65"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f410128%2flogarithm-of-dependent-variable-is-uniformly-distributed-how-to-calculate-a-con%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    3 Answers
    3






    active

    oldest

    votes








    3 Answers
    3






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    4












    $begingroup$


    Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve?




    No, in this case you are dealing with a variable that is log-uniform distributed.



    One approach is to use the bootstrap, where you takes samples repeatedly with replacement and compute the means of the samples.



    See the answers to this question, which deals with log-normal data, but the principles are the same:



    How do I calculate a confidence interval for the mean of a log-normal data set?






    share|cite|improve this answer









    $endgroup$




















      4












      $begingroup$


      Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve?




      No, in this case you are dealing with a variable that is log-uniform distributed.



      One approach is to use the bootstrap, where you takes samples repeatedly with replacement and compute the means of the samples.



      See the answers to this question, which deals with log-normal data, but the principles are the same:



      How do I calculate a confidence interval for the mean of a log-normal data set?






      share|cite|improve this answer









      $endgroup$


















        4












        4








        4





        $begingroup$


        Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve?




        No, in this case you are dealing with a variable that is log-uniform distributed.



        One approach is to use the bootstrap, where you takes samples repeatedly with replacement and compute the means of the samples.



        See the answers to this question, which deals with log-normal data, but the principles are the same:



        How do I calculate a confidence interval for the mean of a log-normal data set?






        share|cite|improve this answer









        $endgroup$




        Can I treat this as log-normal data even though its logarithm is clearly not following a bell curve?




        No, in this case you are dealing with a variable that is log-uniform distributed.



        One approach is to use the bootstrap, where you takes samples repeatedly with replacement and compute the means of the samples.



        See the answers to this question, which deals with log-normal data, but the principles are the same:



        How do I calculate a confidence interval for the mean of a log-normal data set?







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered May 26 at 7:45









        Robert LongRobert Long

        13.3k3 gold badges31 silver badges59 bronze badges




        13.3k3 gold badges31 silver badges59 bronze badges




























            4












            $begingroup$

            In regression problems the marginal distribution of Y does not matter. The conditional distribution of Y | X is what matters. For some problems this translates to examining the distribution of the model residuals.



            But your sample size is too small to check assumptions. It would be far better to use a robust approach that has many fewer assumptions, e.g.




            1. If you have one X and want to quantify the strength of relationship between X and Y, use a rank correlation coefficient

            2. Use a semiparametric regression model such as the proportional odds model that makes no assumption about the distribution of Y | X but only makes assumptions about the relative shapes of conditional distributions across different value of X. This generalizes rank correlation and Wilcoxon-type methods.

            3. Use a Bayesian model that generalizes the usual models, e.g., that has a prior distribution for the degree of non-normality or non-constant variance of conditional distributions.

            4. Use the bootstrap as advised above, but be cautious because the bootstrap is only approximate.






            share|cite|improve this answer









            $endgroup$











            • 1




              $begingroup$
              Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
              $endgroup$
              – Glen_b
              May 26 at 22:14








            • 1




              $begingroup$
              One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
              $endgroup$
              – Frank Harrell
              May 26 at 22:22
















            4












            $begingroup$

            In regression problems the marginal distribution of Y does not matter. The conditional distribution of Y | X is what matters. For some problems this translates to examining the distribution of the model residuals.



            But your sample size is too small to check assumptions. It would be far better to use a robust approach that has many fewer assumptions, e.g.




            1. If you have one X and want to quantify the strength of relationship between X and Y, use a rank correlation coefficient

            2. Use a semiparametric regression model such as the proportional odds model that makes no assumption about the distribution of Y | X but only makes assumptions about the relative shapes of conditional distributions across different value of X. This generalizes rank correlation and Wilcoxon-type methods.

            3. Use a Bayesian model that generalizes the usual models, e.g., that has a prior distribution for the degree of non-normality or non-constant variance of conditional distributions.

            4. Use the bootstrap as advised above, but be cautious because the bootstrap is only approximate.






            share|cite|improve this answer









            $endgroup$











            • 1




              $begingroup$
              Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
              $endgroup$
              – Glen_b
              May 26 at 22:14








            • 1




              $begingroup$
              One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
              $endgroup$
              – Frank Harrell
              May 26 at 22:22














            4












            4








            4





            $begingroup$

            In regression problems the marginal distribution of Y does not matter. The conditional distribution of Y | X is what matters. For some problems this translates to examining the distribution of the model residuals.



            But your sample size is too small to check assumptions. It would be far better to use a robust approach that has many fewer assumptions, e.g.




            1. If you have one X and want to quantify the strength of relationship between X and Y, use a rank correlation coefficient

            2. Use a semiparametric regression model such as the proportional odds model that makes no assumption about the distribution of Y | X but only makes assumptions about the relative shapes of conditional distributions across different value of X. This generalizes rank correlation and Wilcoxon-type methods.

            3. Use a Bayesian model that generalizes the usual models, e.g., that has a prior distribution for the degree of non-normality or non-constant variance of conditional distributions.

            4. Use the bootstrap as advised above, but be cautious because the bootstrap is only approximate.






            share|cite|improve this answer









            $endgroup$



            In regression problems the marginal distribution of Y does not matter. The conditional distribution of Y | X is what matters. For some problems this translates to examining the distribution of the model residuals.



            But your sample size is too small to check assumptions. It would be far better to use a robust approach that has many fewer assumptions, e.g.




            1. If you have one X and want to quantify the strength of relationship between X and Y, use a rank correlation coefficient

            2. Use a semiparametric regression model such as the proportional odds model that makes no assumption about the distribution of Y | X but only makes assumptions about the relative shapes of conditional distributions across different value of X. This generalizes rank correlation and Wilcoxon-type methods.

            3. Use a Bayesian model that generalizes the usual models, e.g., that has a prior distribution for the degree of non-normality or non-constant variance of conditional distributions.

            4. Use the bootstrap as advised above, but be cautious because the bootstrap is only approximate.







            share|cite|improve this answer












            share|cite|improve this answer



            share|cite|improve this answer










            answered May 26 at 11:18









            Frank HarrellFrank Harrell

            58.1k4 gold badges117 silver badges251 bronze badges




            58.1k4 gold badges117 silver badges251 bronze badges











            • 1




              $begingroup$
              Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
              $endgroup$
              – Glen_b
              May 26 at 22:14








            • 1




              $begingroup$
              One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
              $endgroup$
              – Frank Harrell
              May 26 at 22:22














            • 1




              $begingroup$
              Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
              $endgroup$
              – Glen_b
              May 26 at 22:14








            • 1




              $begingroup$
              One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
              $endgroup$
              – Frank Harrell
              May 26 at 22:22








            1




            1




            $begingroup$
            Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
            $endgroup$
            – Glen_b
            May 26 at 22:14






            $begingroup$
            Indeed, on item 4; it would probably be worth investigating how the bootstrap behaves on this problem. The arguments for its properties are large-sample ones and in at least some instances the behavior on small samples can be alarming. In this particular instance I expect it will be fine but its not something it's always safe to assume (i.e. sometimes 'approximate' may be much more approximate than many people realize -- I've seen cases where small sample coverage of a 95% bootstrap interval was much more like 60%).
            $endgroup$
            – Glen_b
            May 26 at 22:14






            1




            1




            $begingroup$
            One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
            $endgroup$
            – Frank Harrell
            May 26 at 22:22




            $begingroup$
            One simulation I did with unbalanced Y showed terrible coverage for all bootstrap intervals (except bootstrap t which I didn't try), with the ordinary Wald interval outperforming them. The regular profile likelihood confidence interval worked fine, i.e., was as accurate as a Bayesian credible interval with a non-informative prior.
            $endgroup$
            – Frank Harrell
            May 26 at 22:22











            3












            $begingroup$

            Something whose log would be close to uniform is somewhat skew, but not particularly difficult to deal with; sample means of size 24 will be very close to normally distributed.



            If it were actually log-uniform we could work out a suitable interval fairly readily but I wouldn't actually use the fact that the sample looks like its log is uniform; with only 24 observations that judgement may be rather suspect and you certainly don't want to be doing such model selection/identification on the very sample you're using for inference, since you don't have a good way of accounting for the effect of that (e.g. it will tend to make intervals narrower than they should be but quantifying how much is rather tricky). If they were actually log-uniform those narrower intervals would be "honestly" narrow, but there's no good basis to say so.



            Simulation at n=24 suggests that a 95% two-tailed t-interval on the untransformed data should perform reasonably well (i.e. give coverage very close to 95%) for data something similar to this, even though this is not actually normal and the distribution of sample means is slightly skew. If you want to go far into the tails it may be more of an issue, but a 95% two-sided interval should be fine.






            share|cite|improve this answer











            $endgroup$















            • $begingroup$
              Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
              $endgroup$
              – Frank Harrell
              May 26 at 11:14






            • 1




              $begingroup$
              Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
              $endgroup$
              – Glen_b
              May 26 at 22:02


















            3












            $begingroup$

            Something whose log would be close to uniform is somewhat skew, but not particularly difficult to deal with; sample means of size 24 will be very close to normally distributed.



            If it were actually log-uniform we could work out a suitable interval fairly readily but I wouldn't actually use the fact that the sample looks like its log is uniform; with only 24 observations that judgement may be rather suspect and you certainly don't want to be doing such model selection/identification on the very sample you're using for inference, since you don't have a good way of accounting for the effect of that (e.g. it will tend to make intervals narrower than they should be but quantifying how much is rather tricky). If they were actually log-uniform those narrower intervals would be "honestly" narrow, but there's no good basis to say so.



            Simulation at n=24 suggests that a 95% two-tailed t-interval on the untransformed data should perform reasonably well (i.e. give coverage very close to 95%) for data something similar to this, even though this is not actually normal and the distribution of sample means is slightly skew. If you want to go far into the tails it may be more of an issue, but a 95% two-sided interval should be fine.






            share|cite|improve this answer











            $endgroup$















            • $begingroup$
              Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
              $endgroup$
              – Frank Harrell
              May 26 at 11:14






            • 1




              $begingroup$
              Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
              $endgroup$
              – Glen_b
              May 26 at 22:02
















            3












            3








            3





            $begingroup$

            Something whose log would be close to uniform is somewhat skew, but not particularly difficult to deal with; sample means of size 24 will be very close to normally distributed.



            If it were actually log-uniform we could work out a suitable interval fairly readily but I wouldn't actually use the fact that the sample looks like its log is uniform; with only 24 observations that judgement may be rather suspect and you certainly don't want to be doing such model selection/identification on the very sample you're using for inference, since you don't have a good way of accounting for the effect of that (e.g. it will tend to make intervals narrower than they should be but quantifying how much is rather tricky). If they were actually log-uniform those narrower intervals would be "honestly" narrow, but there's no good basis to say so.



            Simulation at n=24 suggests that a 95% two-tailed t-interval on the untransformed data should perform reasonably well (i.e. give coverage very close to 95%) for data something similar to this, even though this is not actually normal and the distribution of sample means is slightly skew. If you want to go far into the tails it may be more of an issue, but a 95% two-sided interval should be fine.






            share|cite|improve this answer











            $endgroup$



            Something whose log would be close to uniform is somewhat skew, but not particularly difficult to deal with; sample means of size 24 will be very close to normally distributed.



            If it were actually log-uniform we could work out a suitable interval fairly readily but I wouldn't actually use the fact that the sample looks like its log is uniform; with only 24 observations that judgement may be rather suspect and you certainly don't want to be doing such model selection/identification on the very sample you're using for inference, since you don't have a good way of accounting for the effect of that (e.g. it will tend to make intervals narrower than they should be but quantifying how much is rather tricky). If they were actually log-uniform those narrower intervals would be "honestly" narrow, but there's no good basis to say so.



            Simulation at n=24 suggests that a 95% two-tailed t-interval on the untransformed data should perform reasonably well (i.e. give coverage very close to 95%) for data something similar to this, even though this is not actually normal and the distribution of sample means is slightly skew. If you want to go far into the tails it may be more of an issue, but a 95% two-sided interval should be fine.







            share|cite|improve this answer














            share|cite|improve this answer



            share|cite|improve this answer








            edited May 26 at 9:07

























            answered May 26 at 7:25









            Glen_bGlen_b

            221k23 gold badges437 silver badges791 bronze badges




            221k23 gold badges437 silver badges791 bronze badges















            • $begingroup$
              Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
              $endgroup$
              – Frank Harrell
              May 26 at 11:14






            • 1




              $begingroup$
              Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
              $endgroup$
              – Glen_b
              May 26 at 22:02




















            • $begingroup$
              Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
              $endgroup$
              – Frank Harrell
              May 26 at 11:14






            • 1




              $begingroup$
              Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
              $endgroup$
              – Glen_b
              May 26 at 22:02


















            $begingroup$
            Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
            $endgroup$
            – Frank Harrell
            May 26 at 11:14




            $begingroup$
            Overall coverage is not sufficient. What are the two tail (non-coverage) probabilities?
            $endgroup$
            – Frank Harrell
            May 26 at 11:14




            1




            1




            $begingroup$
            Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
            $endgroup$
            – Glen_b
            May 26 at 22:02






            $begingroup$
            Whether it's sufficient or not really depends on the application; if you want the advertized coverage and essentially get it, you might well be content. Roughly speaking one's about 3% (a bit under), the other's about 2%. The left tail of the distribution of the t-statistic is "short".
            $endgroup$
            – Glen_b
            May 26 at 22:02




















            draft saved

            draft discarded




















































            Thanks for contributing an answer to Cross Validated!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f410128%2flogarithm-of-dependent-variable-is-uniformly-distributed-how-to-calculate-a-con%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Færeyskur hestur Heimild | Tengill | Tilvísanir | LeiðsagnarvalRossið - síða um færeyska hrossið á færeyskuGott ár hjá færeyska hestinum

            He _____ here since 1970 . Answer needed [closed]What does “since he was so high” mean?Meaning of “catch birds for”?How do I ensure “since” takes the meaning I want?“Who cares here” meaningWhat does “right round toward” mean?the time tense (had now been detected)What does the phrase “ring around the roses” mean here?Correct usage of “visited upon”Meaning of “foiled rail sabotage bid”It was the third time I had gone to Rome or It is the third time I had been to Rome

            Slayer Innehåll Historia | Stil, komposition och lyrik | Bandets betydelse och framgångar | Sidoprojekt och samarbeten | Kontroverser | Medlemmar | Utmärkelser och nomineringar | Turnéer och festivaler | Diskografi | Referenser | Externa länkar | Navigeringsmenywww.slayer.net”Metal Massacre vol. 1””Metal Massacre vol. 3””Metal Massacre Volume III””Show No Mercy””Haunting the Chapel””Live Undead””Hell Awaits””Reign in Blood””Reign in Blood””Gold & Platinum – Reign in Blood””Golden Gods Awards Winners”originalet”Kerrang! Hall Of Fame””Slayer Looks Back On 37-Year Career In New Video Series: Part Two””South of Heaven””Gold & Platinum – South of Heaven””Seasons in the Abyss””Gold & Platinum - Seasons in the Abyss””Divine Intervention””Divine Intervention - Release group by Slayer””Gold & Platinum - Divine Intervention””Live Intrusion””Undisputed Attitude””Abolish Government/Superficial Love””Release “Slatanic Slaughter: A Tribute to Slayer” by Various Artists””Diabolus in Musica””Soundtrack to the Apocalypse””God Hates Us All””Systematic - Relationships””War at the Warfield””Gold & Platinum - War at the Warfield””Soundtrack to the Apocalypse””Gold & Platinum - Still Reigning””Metallica, Slayer, Iron Mauden Among Winners At Metal Hammer Awards””Eternal Pyre””Eternal Pyre - Slayer release group””Eternal Pyre””Metal Storm Awards 2006””Kerrang! Hall Of Fame””Slayer Wins 'Best Metal' Grammy Award””Slayer Guitarist Jeff Hanneman Dies””Bullet-For My Valentine booed at Metal Hammer Golden Gods Awards””Unholy Aliance””The End Of Slayer?””Slayer: We Could Thrash Out Two More Albums If We're Fast Enough...””'The Unholy Alliance: Chapter III' UK Dates Added”originalet”Megadeth And Slayer To Co-Headline 'Canadian Carnage' Trek”originalet”World Painted Blood””Release “World Painted Blood” by Slayer””Metallica Heading To Cinemas””Slayer, Megadeth To Join Forces For 'European Carnage' Tour - Dec. 18, 2010”originalet”Slayer's Hanneman Contracts Acute Infection; Band To Bring In Guest Guitarist””Cannibal Corpse's Pat O'Brien Will Step In As Slayer's Guest Guitarist”originalet”Slayer’s Jeff Hanneman Dead at 49””Dave Lombardo Says He Made Only $67,000 In 2011 While Touring With Slayer””Slayer: We Do Not Agree With Dave Lombardo's Substance Or Timeline Of Events””Slayer Welcomes Drummer Paul Bostaph Back To The Fold””Slayer Hope to Unveil Never-Before-Heard Jeff Hanneman Material on Next Album””Slayer Debut New Song 'Implode' During Surprise Golden Gods Appearance””Release group Repentless by Slayer””Repentless - Slayer - Credits””Slayer””Metal Storm Awards 2015””Slayer - to release comic book "Repentless #1"””Slayer To Release 'Repentless' 6.66" Vinyl Box Set””BREAKING NEWS: Slayer Announce Farewell Tour””Slayer Recruit Lamb of God, Anthrax, Behemoth + Testament for Final Tour””Slayer lägger ner efter 37 år””Slayer Announces Second North American Leg Of 'Final' Tour””Final World Tour””Slayer Announces Final European Tour With Lamb of God, Anthrax And Obituary””Slayer To Tour Europe With Lamb of God, Anthrax And Obituary””Slayer To Play 'Last French Show Ever' At Next Year's Hellfst””Slayer's Final World Tour Will Extend Into 2019””Death Angel's Rob Cavestany On Slayer's 'Farewell' Tour: 'Some Of Us Could See This Coming'””Testament Has No Plans To Retire Anytime Soon, Says Chuck Billy””Anthrax's Scott Ian On Slayer's 'Farewell' Tour Plans: 'I Was Surprised And I Wasn't Surprised'””Slayer””Slayer's Morbid Schlock””Review/Rock; For Slayer, the Mania Is the Message””Slayer - Biography””Slayer - Reign In Blood”originalet”Dave Lombardo””An exclusive oral history of Slayer”originalet”Exclusive! Interview With Slayer Guitarist Jeff Hanneman”originalet”Thinking Out Loud: Slayer's Kerry King on hair metal, Satan and being polite””Slayer Lyrics””Slayer - Biography””Most influential artists for extreme metal music””Slayer - Reign in Blood””Slayer guitarist Jeff Hanneman dies aged 49””Slatanic Slaughter: A Tribute to Slayer””Gateway to Hell: A Tribute to Slayer””Covered In Blood””Slayer: The Origins of Thrash in San Francisco, CA.””Why They Rule - #6 Slayer”originalet”Guitar World's 100 Greatest Heavy Metal Guitarists Of All Time”originalet”The fans have spoken: Slayer comes out on top in readers' polls”originalet”Tribute to Jeff Hanneman (1964-2013)””Lamb Of God Frontman: We Sound Like A Slayer Rip-Off””BEHEMOTH Frontman Pays Tribute To SLAYER's JEFF HANNEMAN””Slayer, Hatebreed Doing Double Duty On This Year's Ozzfest””System of a Down””Lacuna Coil’s Andrea Ferro Talks Influences, Skateboarding, Band Origins + More””Slayer - Reign in Blood””Into The Lungs of Hell””Slayer rules - en utställning om fans””Slayer and Their Fans Slashed Through a No-Holds-Barred Night at Gas Monkey””Home””Slayer””Gold & Platinum - The Big 4 Live from Sofia, Bulgaria””Exclusive! Interview With Slayer Guitarist Kerry King””2008-02-23: Wiltern, Los Angeles, CA, USA””Slayer's Kerry King To Perform With Megadeth Tonight! - Oct. 21, 2010”originalet”Dave Lombardo - Biography”Slayer Case DismissedArkiveradUltimate Classic Rock: Slayer guitarist Jeff Hanneman dead at 49.”Slayer: "We could never do any thing like Some Kind Of Monster..."””Cannibal Corpse'S Pat O'Brien Will Step In As Slayer'S Guest Guitarist | The Official Slayer Site”originalet”Slayer Wins 'Best Metal' Grammy Award””Slayer Guitarist Jeff Hanneman Dies””Kerrang! Awards 2006 Blog: Kerrang! Hall Of Fame””Kerrang! Awards 2013: Kerrang! Legend”originalet”Metallica, Slayer, Iron Maien Among Winners At Metal Hammer Awards””Metal Hammer Golden Gods Awards””Bullet For My Valentine Booed At Metal Hammer Golden Gods Awards””Metal Storm Awards 2006””Metal Storm Awards 2015””Slayer's Concert History””Slayer - Relationships””Slayer - Releases”Slayers officiella webbplatsSlayer på MusicBrainzOfficiell webbplatsSlayerSlayerr1373445760000 0001 1540 47353068615-5086262726cb13906545x(data)6033143kn20030215029