Well I am not the source of God’s truth. So I am sure he can refute me on that. =)
Exactly right. It is on page 11.
“Creates” is too strong a term. Rather, randomness is a source of information.
True random generators are a source of information, because they are high entropy and are not compressible. True random generators (e.g. from cosmic background radiation, quantum noise, brownian motion, radioactive decay geiger counts) all produce pure information.
Pseudorandom generators in a precise technical sense are not high information, because the stream is compressible to the seed and the random algorithm. However, in practice they do produce strings indistinguishable from high information. If it is a good pseudorandom generator, the key and algorithm are secret, and we keep a secret that it is a pseudorandom string, it is effectively impossible to distinguish a pseudorandom string from information. It will be incompressible and (nearly infinite) information to anyone who does not know the compression.
This is the surprising feature about information, it is exactly equal to entropy, which is highest in random streams.
How so? Information is meaningful only to the sender and receiver (and the spy). To all others it’s noise. Also, once again don’t forget the deciphering key and the mandatory redundancy.
The Infinite Monkeys theorem affirms that randomness could create Hamlet or The Odyssey (but the argument is really about life forms, not about literature). Indeed, a random process could theoretically generate these masterpieces. And if we allow for many alternative targets (like any document ever created), the probability of success goes up substantially. Quite likely, the “monkeys” would have duplicated many other information (like chemical formulas) way before typing Hamlet. But monkeys care about bananas, not Hamlet, so the random output remains meaningless until an educated reader assigns meaning based on his/her prior knowledge. Hamlet and Odyssey are important precisely because we recognize them as non-random. They fit in our history and culture and have been preceded and followed by other non-random creations. Creators, not Randomness, provide meanings. More: http://nonlin.org/random-abuse/
How so? By logic clearly laid out in this foundational paper. Since 1954, the definition of information has not changed. Information = Entropy. Without this paper, information theory may not have come to be.
And I have no idea what this mandatory redundancy is of which you speak. Nor is a deciphering key relevant all. Who enforces these rules? Information equals entropy independent of these concerns.
You seem to be confusing information and meaning. Information does not .deal directly with semantics. And as I have explained, semantic information is extremely low information content.
Which then raises the question, why in the world we use information content of data (like DNA and genomes) as a measure of “meaning” and semantics? Information is entropy, not meaning. And DNA does not convey meaning. It just holds information, and much of this information records history, like bread crumbs marking a trail through time.
I recommend that you don’t spend too much time repeating your absolute rejection of a career researcher on a topic from which he makes a living.
Sure… reject his position as a matter of due course. Because then you can discuss your different ideas. But if it looks like all you are doing is rejecting everything he says, over and over, I’ll be flagging your postings accordingly. And then it will be up to the Administrators…
I won’t pretend to know a fraction of the science you guys know. I became a Christian not because I am smart. I became a Christian because I chose to have faith in God and His gospel. And where did that faith come from? It came from the Word of God- “Faith comes from hearing.” And this faith has absolutely transformed my life from the inside out! I once was selfish and mean spirited and now when I see someone in a position of need or weakness such as some of the mentally handicapped folks bagging groceries at Kroger or those poor helpless girls mistreated in the sex trade, I just want to pray out to God on their behalf and do something to help them! The idea of racial discrimination I must say takes the cake as one of the most foolish things mankind has come up with! I love all people…and I don’t want accolades for saying any of this. I actually feel uncomfortable saying any of this in a way…but making much of God and less of me brings much joy anyway and I cannot help but to say it. How was this faith generated? Not my intelligence. Not much of that here…It was generated again by having faith in the God of the Bible that was generated and given by the God of the Bible and the gospel of His Son dying in my place! It has turned me upside down, inside out, and upright from a place of being hunched over in disobedience and unbelief.
My faith also comes from another place that is God ordained. I love nature! I love its beauty, its colors, its functional balance. I am amazed at the complexity of the brain and how God created sexual beings for reproduction and symbiotic relationships between plants and animals and all of the creative designs in animals and flowers and colors in fish (#1 favorite vacation endeavor has been snorkeling reefs although it has been awhile) Then you have the dynamics needed to even make earth habitable for life to exist…things like the position and size of the earth’s moon, the earth’s magnetic field, its atmosphere, the presence of water, the fact that water in its frozen state is unusually less dense than its liquid state thus able to float…and all those other planets floating in space and rotating about stars in a universe stretching billions of light years etc. God calls these things a basis for faith in Him as well. In Romans 1:20 it says “God’s invisible qualities-his eternal power and divine nature-have been clearly seen, being understood from what has been made, so that men are without excuse.”
Have very little understanding of the specific scientific arguments back and forth between ID and theistic evolutionists. At face value the idea of chance causing complexity like we see it today no matter how much God lipstick you put on it does not sit well with me at all…I still must sit back (in my simpleton way) and suggest that if folks still want to argue the details of two views, maybe consider laying down the argument and put our energies as Christians towards a unified effort that finds a priority of grounds for worshipping Him as our Creator and Designer who has indeed clearly revealed Himself in creation. And we must stop pretending that our intellectual pride and the potential profitability from a book deal or in an occupation does not affect our propensity for stiff arming unity for arguing over some semantics for attention sake. I am still a sinner who can only understand this temptation from ongoing personal experience thankfully occurring less and less in me! .
And His Gospel that frees me from this tendency creates a paradigm that eliminates both sniveling and swaggering (thank you Dr. Keller) “so that no man may boast” which also declares GOD! He is coming back soon and for one don’t want to have my pants down if He does in my lifetime.
Sometimes I want to sense that we become so obsessed with the trees in these scientific details arguing chance vs design (amongst Christians nonetheless who are called to have faith in an Intelligent Designer) that this blinds us from the forest where that God does indeed dominate, rule and always longs for men to bask in his loving presence to find blessing in worshipping Him!
You guys are so smart! I am blessed more than you will know reading a lot of these items on this website. I was led by another to check out a quote from this segment I thought so pertinent and likeminded to the sentiment here and wanted to add another two cents. Anyone here and otherwise who is offering their genius towards the proclamation of the God who describes himself in His word as an Intelligent Creator and an all wise Designer -I honor you! Thanks for listening to this incredibly less smart country boy ramble!
Absolutely - that’s why Joshua and I generally get on so well even when we disagree, both here and elsewhere.
Sadly not everyone sees things his way, either in the EC camp or the ID camp - and certainly in the metaphysical naturalism camp that prevails within the biological “guild”. There’s a tendency to see the “unexplained information” as “chance” and therefore quite possibly or probably undesigned and undirected.
And as for the “explained” information, that is, whatever lends itself to explanation by the laws of nature, that is often seen as secondary causation running autonomously from God, rather than as a channel of divine providence in its “general”, predictable, aspect.
The classical doctrine of providence is exactly as Joshua has stated it: the governance of all things towards their intended ends. The"novel" component in Joshua’s statement is the agnosticism of information theory - which of course threatens equally both “this shows the marks of design” and “this shows signs of randomness”. That leaves one back with having to make a choice based on metaphysical and theological commitments, rather than science.
To be fair, universal providence is recognised by all the main Intelligent Design people too, such as Michael Behe, Douglas Axe, William Dembski, Steve Meyer. The claim (right or wrong) that there are instances where design can be detected in some scientific way is emphatically not a belief that only those things come under God’s designing providence - that seems rather to be a straw-man criticism by their detractors.
Amen. With your focus here, it does not matter what you think of the details of our origins. I share of information theory because it is fun for me revel in God’s work in our world. I am glad you have enjoyed it.
Though I would point to Jesus. He is the clearest revealing of the Creator. If you have seen Him, you have seen the Father.
Though the novelty here is only marginal. It does not take a lot of math to realize that unexplained patterns in data are not evidence of anything other than noise and finite understanding. And in the case of ASC, neither is the opposite true; explained patterns in the data are not evidence of intelligence either, because a lot of processes impart patterns on data. Therefore, we cannot presume to prove or disprove God with an equation.
Besides, I find the Word in the flesh, Jesus, is much more compelling than any equation could ever be. And I say this even though I love equations.
Do you know how correct you are here?
His arguments, to the extent I understand them, persuade me, and actually reinforce the point above that chance and design cannot be formally distinguished. Since that is counterintuitive, it leads again to the possibility that the explanation for this indistinguishability of opposites is that “chance” is only and always, in reality, God’s choice. Chance looks the same as choice simply because chance always is choice, the providential choices of the logos of God. The distinguishing marks of the impossible | The Hump of the Camel
You are echoing Shannon’s language precisely in the original paper (see page 10 right before the information = entropy equation on page 11).
From his point of view, he is not actually formulating this in terms of “chance,” but in terms of “choice.” Of course, the parallel derivation in thermodynamics is rather about “chance”. Both,ultimately derivations are encoding uncertainty from a particular point of view, but end up with exactly the same equation.
One could even say that the foundation insight of information theory is that “choice = chance”, at in a mathematical case.
Someone theological needs to connect this to the “scandal of particularity” and God’s autonomy…
My apologies for only now seeing your response.
My dear sir, you are completely wrong about this.
My original statement said, Any lock with a finite series of numbers.
You apparently do not understand how easy this is. As a young father, I was faced with my son’s friend who had a 4 position bicycle lock. You know… 4 wheels with digits from 1 to 9. And he didn’t remember the combination.
So I sat down, and while talking to him began to rotate each disk, one position at a time, then one disk at a time. Starting at 0000, going from 1111 to 1199, and continuing. Somewhere around 32xx the lock opened.
That is how a random number generator can eventually pick any finite series lock. But it could take a while.
Do you understand my assertion now? Or do you still want to dispute it?
Many thanks Joshua, this is very clear and useful.
I’m a physicist, and I have a question on entropy. I hope it won’t be too technical. Here it is:
Take a system with total energy E. It has an Hamiltonian H, a E is an eigenvalue of H. If I remember well, you can also define its entropy S, like S = k Ln N, where N is the degree of degeneracy of the eigenvalue E (or the dimension of the Eigenspace associated with E).
Here’s my question: if the system is isolated, its energy E won’t change with time. So N shouldn’t change either, so S. You would then conclude that S won’t increase, which contradicts the 2nd law.
Where’s the mistake?
Many thanks!
Antoine
If the system is in an eigenstate, then it is a in a stationary state and doesn’t change at all. There is no requirement that S increase in a system that undergoes no change.
There are several caveats/qualifier to the 2nd law. It is not a universal rule. Perhaps it should not even be called a “law.”
Here comes the first caveat. At equilibrium dS will approximately = 0. So if the system hits equilibrium, S well remain essentially constant. The second law is really more like dS >= 0 than a dS > 0. In simplified idealized simulations (like those we are discussing), it is common for the system to stabilize and S to stabilize at a specific value.
The second caveat is that the second law does not hold in small systems. Interestingly enough, in molecular systems it is well known however, that there can be fluctuations where dS < 0. So the 2nd law is not an inviolable law Second law broken | Nature. It is better to think of it like the Central Limit theorem for gaussian distributions. The larger the system the stronger it will hold
The reason why this is really important. As Maxwell correctly puts it…
The truth of the second law is … a statistical, not a mathematical, truth, for it depends on the fact that the bodies we deal with consist of millions of molecules… Hence the second law of thermodynamics is continually being violated, and that to a considerable extent, in any sufficiently small group of molecules belonging to a real body. Second law broken | Nature
This, once again, is a surprising fact. What we understand about macroscopic bodies does not hold when we go down to small numbers of particles. We have to rework our understanding of these things substantially. Of course, is in this realm too, and can see its entropy increase and decrease by natural processes alone.
We all have gifts. some have mercy, others have strengths related to intelligence. We can use these things to glorify God.
We must be careful however. the weakness found in those with mercy might be the fear of man. The weakness found in those who are intelligent might be to stiff arm wisdom from God for reliance on personal intelligence.
I have indeed changed Mr. Brooks! I came into biologos searching for answers and it seems that I have come out the back end finding hope in God as Creator who could have created in any fashion He would choose more than I did coming into the forums. I have found really smart folks here but find myself trusting wisdom from God more…this is not to say that I am insincere in complementing those who are brilliant! Ravi Zacharius is one of the most brilliant people I have ever encountered yet his gaze seems to be well placed on God’s Word and heavenly wisdom and not earthly.
You can look it up. DNA base pairing, 3’-5’ ends, and telomeres are all examples of mandatory redundancy.
The key is absolutely essential. Remember Rosetta Stone? Even assuming the random generator creates information, you do not have a key for it.
in·for·ma·tion
ˌinfərˈmāSH(ə)n/
noun
1.
facts provided or learned about something or someone.
“a vital piece of information”
synonyms: details, particulars, facts, figures, statistics, data; More
2.
what is conveyed or represented by a particular arrangement or sequence of things.
“genetically transmitted information”
I do not.
He already told you not to make him into an idol. It seems you didn’t get that message.
Sorry, but your explanation is childish and wrong. You opened the lock, not a random number generator. You, the human, can use a random number generator to help you, the human, reach your willful goal.
The hammer doesn’t build a house. Instead the human can use a hammer to build a house of his/her desire. Get the difference?
Aside from this, “any lock with a finite series of numbers” is a gross exaggeration. Just try three times with your bank account and you will find your IP address locked out of this scheme.
Okay everyone, I need to start with a big retraction. The last post had a major error in it. I’m sorry for putting that out there. I made a mistake. I guess this is a great opportunity to demonstrate in public that I will retract mistakes I made. I’ve deleted the offending section, so the current previous post is correct. To briefly explain (part) of the confusion, I inferred incorrectly the question and extrapolated to the part of physics I am working with the most QM, and then made some large errors because of this. This answer, I’m sure is the correct one.
===========================
So this is a good question, but let me clarify something here. The use of a hamiltonian and the way you compute total energy is really irrelevant here. So I am going to reword the question. I think you are asking…
In an isolated system where total energy does not change, what happens to S and the number of microstates?
Now if this is not the right question let me know. If you are talking about eigenvalues, perhaps you are actually talking about quantum mechanics (like I originally thought), but then there is problem with your question. So please do clarify.
Nonetheless, I will answer this question for now.
==========
First off a key point is that total energy (which is usually defined as kinetic energy plus potential energy) does NOT include entropy at all. So in a constant energy simulation, entropy will go down. That is the simplest way to explain your error. You thought entropy was part of total energy, but it is not.
The maximum entropy principle: For a closed system with fixed internal energy (i.e. an isolated system), the entropy is maximized at equilibrium.
The minimum energy principle: For a closed system with fixed entropy, the total energy is minimized at equilibrium.
So the point is that if you are doing simulation #1, you will see entropy increase over time (with the caveats I raised earlier).
==================
This can be further generalized with thermodynamic potentials… Thermodynamic potential - Wikipedia, all depending on what we keep fixed in the system.
Internal Energy is minimized if entropy and volume is kept constant.
Hemholtz Free Energy is minimized if temperature (kinetic energy) and volume is kept constant.
Enthalpy is minimized if entropy and pressure is kept constant.
Gibbs Free Energy is minimized if temperature and pressure `is kept constant.
Landau Potential is minimized if temperature and volume is kept constant.
Given the specific constraints, we pick the right potential. And this potential will move downhill during as the system evolves. Notice that “Energy” here depends on the exact thermodynamic context of the system, and entropy may or may not be fixed.
To be clear, these are all just restating the 2nd law of thermodynamics, but explaining how the thermodynamic observables will evolve given specific thermodynamic constraints. Part of the earlier confusion is that in biological simulations (where my effort is focused) we are almost always doing #4 calculations, so my focus has always been on Gibbs Free Energy (constant temperature and pressure).
=============
So what does this mean for S and the number of microstates N? Well, depending on the simulation, S (the entropy) may or may not be increasing. S will always be related by the equation…
S = k ln N
Where k is a constant (that corresponds to a conversion term) and N is the number of possible internal states that the system is in. I say this is approximate, because we really want the sum of (e^{-(E_s-min_s_E)` / temperature}) of all states, not just the cases where the E’s are equal.
In these cases, we are saying that the probability of being in a state is proportional to e^{-(E_s-min_s_E). With the right normalization, entropy is just the same formula for information.
S = - sum p log p
In this case, p = 1/N for all states (where all the E’s are equal). Which then becomes…
S = - sum 1/N log 1/N
S = sum 1 / N log N
And remember that the sum is over N states, so this becomes…
S = log N
But it is important to point out that this is a pure number with no units attached. We have to scale this somehow. For example, we can convert this to bits (the way how comp sci people think about this) by multiplying by 1/log 2…
S = log_2 N bits
Or we could scale this to the same units of energy. The exact details of that constant, if I remember right, are dependent on the units system. But we know that it will just be a multiplicative factor k…
S = k log N
So here is where we make the connection to Shannon. We can say that S is the INFORMATION required fully describe a system given we know the entities of the system the natural variables (the fixed quantiteis above) and E.
There is nothing in information theory that tells us that redundancy is mandatory. So I suppose you are say the fact that there is redundancy is important somehow? Okay…I just do not follow your logic. You wrote this earlier…
I just do not understand your point.
Now you are quoting the dictionary definition of information, which is not precise or quantitative. It is also mixed up with the notion of semantics and meaning. This has very little to do with information theory.
You can go down this path, but now how do you propose quantifying the information in DNA? What do you mean by information? How do you know you are computing what you think you are?
So what? If this is random data, there is not key. The only semantic value is what I assign to it.
I will also point out that DNA does not have a key either. It is not very much like language at all. It does not convey ideas or images or thoughts. It is not abstract, or recursive. DNA is just a physical thing that is processed to produce proteins that do things. Part of what makes biology so hard is that it is not organized very much at all like a human language.
The difference is between an idealized model and a realistic one.
Sure, in the idealized model both sender and receiver have the key and there is no communication loss. But in the realistic model, the key is sent to the receiver as a separate packed of data. In biology we don’t see the key being sent from DNA to mRNA to ribosomes to proteins but they all have a chemical key nonetheless and that’s not included in your equality. Asymptotically this bit of information doesn’t matter much but it’s there and subtracts from your equality.
In a realistic model (with losses), redundancy becomes mandatory to compensate for said losses. You can read more about Error Detection and Correction here: Error detection and correction - Wikipedia
DNA is more than 50% redundant (the two strands + endings + ?) but mRNA (single strand) is less than that probably because it takes much less time to do its mission.
Take the DNA (sender) genetic code again - the ribosome (receiver) knows what to do with it, no problem. To us humans (spy) it is not all information because we do not yet have the full deciphering key. But to a cat it is all noise in any form.
Information is what gets passed from entity A to entity B via some channel and is understood by both parties. Without a key, there is no information. You can just assign semantic value at will, but that is not information as it lacks common understanding to both A and B. I already stated that DNA has a key for sure even if not apparent.
There was another dispute about “random number generator opening any lock”. I hope that got clarified: the human opens the lock, not the random generator. The random generator is just a tool to the human.
That is ridiculous. Saying a random number generator is not relevant to solving a kick combination is like saying DNA isn’t relevant to animal sex drive because DNA is not a sexual organ.
The point of my example is to show that “information” can be accumulated even without Intentionality.