> Doing it on demand still utilizes their cached version, so it saves a trip to the origin, but doesn’t require doubling the cache size. They can still cache the results if the same site is scraped multiple times, but this saves having to cache things that are never going to be requested.
Isn't this solving a slightly, but very significantly different problem?
You could serve the very same data in two different ways: One to present to the users and one to hand over to scrapers. Of course, some sites would be too difficult or costly to transform into a common underlying cache format, but people who WANT their sides accessible to scrapers could easily help the process along a bit or serve their site in the necessary format in the first place.
But the key is:
A tool using a "pre-scraped" version of a site has very likely very different requirements of how a CDN caches this site. And this could be easily customizable by those using this endpoint.
Want a free version? Ok, give us the list of all the sites you want, then come back in 10min and grab everything in one go, the data will be kept ready for 60s. Got an API token? 10 free near-real-time request for you and they'll recharge at a rate of 2 per hour. Want to play nice? Ask the CDN to have the requested content ready in 3 hours. Got deep pockets? Pay for just as many real-real-time requests as you need.
What makes this so different is that unless customers are willing to hand over a lot of money, you dont need to cache anything to serve requests at all. Potentially not even later if you got enough capacity to serve the data for scheduled requests from the storage network directly.
You just generate an immediate promise response to the request telling them to come back later. And depending on what you put into that promise, you've got quite a lot of control over the schedule yourself.
- Got a "within 10min" request but your storage network has plenty if capacity in 30s? Just tell them to come back in 30s.
- A customer is pushing new data into your network around 10am and many bots are interested in getting their hands on it as soon as possible, making requests for 10am to 10:05? Just bundle their requests.
- Expected data still not around at 10:05? Unless the bots set an "immediate" flag (or whatever) indicating that they want whatever state the site is in right now, just reply with a second promise when they come back. And a third if necessary... and so on.
> The real problem to UBI is governments creating income via debt, IMO.
The national debt is just a hidden tax on future generations. You're stealing resources from the future (by selling claims to them in advance, that's what national debt is) and spending them in the present. It's justifiable in extreme cases like a war (or perhaps for massive public investments that can't be funded within the existing budget - which is actually not that common), but really not otherwise.
That's not how that works, because for each unit of debt (loans or negative balances) there is a corresponding unit of credit (bonds or positive balances) in the economy. Hence, mathematically speaking, all debts could be paid off instantly at any point in time.
The reason why the debt keeps growing endlessly is that there is a 0% lower bound on the interest rate, which if you think logically about it, means that debt can only grow, mathematically speaking. This creates the impression that debt is always a future burden that is eternally carried forward as if it was nuclear waste.
If the market interest rate is below zero, either the government and the central bank must intervene to maintain the state of the money system above zero, because that is the only representable state. The government can subsidize the difference between the market interest rate and the money system interest rate clamp by taking on private debt and turning it private. This is particularly evident once private corporations refuse to take on further debt.
However, even if the government stopped the subsidization, you still don't get out of the conundrum. The government is patching the symptom with its cause, which stalls the problem into the future, which is "good" if the cause is considered good and only the symptom is considered bad.
The same way housing is needed for living, money is needed for trading. Similar to housing becoming an investment and therefore no longer being able to be used for its intended purpose, money can face the same fate. When people use money as an investment, it can't be used for trading. Houses sit empty and money sits idle.
It turns out that money is such an integral part of the economy that if there is no money, people can't acquire the goods they need to survive and since there is a monopoly on money systems, you can't just switch to a private provider to perform the trading you need in case the government one fails.
In other words, you either choose between a fully formalized money based economy or subsistence lifestyle with nothing in-between. The difference between the two is so stark, that a failure in the money system might as well be the collapse of all elements of society. From that perspective, it is quite smart to keep kicking the debt can down the road. Meanwhile the person who refuses to kick the can will doom society unless they implement the possibility of negative interest in their money system.
The zero bound on nominal interest rates is not relevant today. (It may be relevant in a deflationary environment where debt or 'safe assets' are essentially needed as a liquidity instrument akin to money, but that all gets hoovered up when interest rates rise.) The U.S. government is paying a whole lot of interest on its national debt bonds not because of a formal constraint, but rather because its bonds would go unsold otherwise, it would be unable to roll over the existing bonds as they expire, and the whole house of cards would collapse. IOW, it's the chickens coming home to roost, and the American taxpayer is paying for it. The alternative is to inflate the debt away by debasing the currency, which is even worse.
I've often thought of state debt as an accruing tax collection deficit. Selling bonds (creating more of this debt) is more politically convenient than raising taxes but it digs a deeper hole and obliges the state to pay interest largely to the same class of people they have failed to tax.
If your business can't self-fund the investment, borrowing is justified. But if you're earning revenue that allows you to self-fund, why borrow? You're just incurring extra costs.
I feel like government borrowing sometimes and government borrowing more and more every year and never paying it down until the end of time or more likely bankruptcy are two different things
As long as you keep new borrowing below growth then you can do that indefinitely. The problem is when the next pandemic (or war) comes along you don't have much room to deal with it.
You can do the same with printing money, as long as you do it below growth you can do it indefinitely.
The problem always is that you can't stop and get off the tiger. No country can withstand the shock of a major cut in spending, because the population can't absorb the hit.
$5 is probably too much, tho. I'd be looking more at the $.2 to $1 range.
Maybe a 3 to 4 tier inbox. Known and trusted user being able to contact you without paying, a high value inbox for the $1+ range, a low value inbox for the $.2 range emails wont be auto-deleted in and a very low value inbox emails will be deleted in depending on the amount paid, with free mails being gone within e.g. an hour, all the way up to e.g. a month for $.19 mails.
Then unify those inboxes and set up notifications to the users' likings.
Also, I'd normalize e.g. 10% going to the e-mail service providers and enshrine that amount into the protocol right away. Otherwise the protocol wont get a lot of attention from the major providers and if it does, the provider taking his share is going to become normalized anyway. But then the split isn't going to be in favor for the users. Which isn't negative per-se, but it'd be nice to have at least one type of service where this is split is reversed. And it is fair to assume whoever takes the larger split has more influence on the prices, potentially either making this feature useless or pricing very casual users out of the service.
Isn't Shanghai a Tier 1 city? IMO it's not very representative of the whole country.
It's also not like China is an overachieving outlier, but western nations actively having been sabotaged by its leadership at least since 1990 and MUCH MUCH more so since occupy wallstreet.
FFS Germany is blowing up its nuclear powerplants on a never before seen record breaking schedule so that a potential successor government cant reactivate them.
Interesting, never heard anyone calling some place a Tier 1.5 city. Is this a recent development as "almost official" as the Tiers itself, something obvious I just never picked up on or people taking pride in their Tier 2s doing really well?
Also why does the Tier list keep expanding downwards? Wasn't being called a Tier 4 basically exclusively an insult? Sub culture not being satisfied with just embracing rotting anymore, but now racing for the bottom of the sea?
Exactly, this was the whole point of Trump calling climate change a hoax to benefit China, but somehow this got twisted by the media into not denying climate change being an anti-Trump position.
The base then started demanding this from their reps and Trump almost picked up on this himself. It took years to undo that damage and even now we're barely back at a pro-clean air, pro-solar and pro nuclear position...
This is why politicians are usually expected to choose their words carefully. Most of them know that what they say matters and has effects on the real world.
> Except for the victims of sexual abuse perpetrated by their clergy.
I honestly wonder how much of this is made up. Given the size of whole organization and it holding onto its weird priciples regarding the personal relationships of its members (introduced in the far past to limit the secular power of its clergy), there certainly will be SOME cases.
But in the one case a frater, who I knew, got convicted, he definitely didn't do it. He was accused by several independent former students and even some of the staff backed the students claims with first hand accounts of him having been alone with some of the students at the time. This supposedly happened on a trip with tight schedules, so all accounts and stated times were quite specific, even in the pre-smartphone era.
The only problem: He wasn't with the group at that time at all. I screwed up embarrassingly (and the staff, too, leaving a young student stranded in the middle of nowhere) and he thought he could slip out, come pick me up and nobody (but maybe me with him) would get in trouble over it. Turned out he forgot refueling, both of us stayed at a pastor's guest house and he called the group telling them, that they should go ahead without us and that we would drive to the event directly on our own. The supposed abuse was claimed to have happened at another short stay of the group where they spent a day visiting some mine before joining with us again.
Almost 3 decades later he got railroaded in court, me learning about it in the news.
I'm confused. You heard about someone you knew being wrongfully convicted of a crime he didn't commit and you could have provided the testimony to clear him, but you just decided not to? Why not?
I never was contacted during the trial and only read about it almost 2 years later in the news.
Also, he's a man of strong faith, not that he knows he'll win in the end, but more like that it just doesn't have the same importance for him as it would have for us. I only had a short opportunity to ask him about it since then and basically he doesn't think there is just about any chance to win this, what he's most worried about is ruining the public image of his students (including his accusers) and since his order allowed him to rejoin and start over, in practice, he got all he wanted to ask for already.
The Catholic Church was funding a lot of research for a long time. E.g the Elon Musk of his time, Galileo, was famously sponsored by it and when asked to contrast his theories against the established view, sperged out so hard against the people tasked with reviewing his publications, they tossed him under the carriage.
Friendly reminder he EXPLICITLY ran on protecting debt-limits in the German constitution, got elected on those promises and then changed course literally on day 1 after being elected.
Okay, yeah, sure, maybe the "don't assume malice" is out the window at this point. There are things he's genuinely incompetent on, though. Just google "Merz realitätsfern" (= lost touch with reality).
> Friendly reminder he EXPLICITLY ran on protecting debt-limits in the German constitution, got elected on those promises and then changed course literally on day 1 after being elected.
Having less debt was indeed a major election topic of the CDU. But often in summaries of the media it was reported as if it he was against debts completely, while when he was asked in interviews if he wanted to abolish the dept-limit, he clearly refused to deny it. He answered that he *also* wants to cut funding to reduce the budget elsewhere. So in my opinion, the reports about him reversing course completely where exaggerated, and his actions were an obvious continuation to his prior election talks.
I'm honestly surprised this issue in general didn't cause nearly every company to immediately ban all AI.
Why do these companies put so much effort into fighting right to repair to avoid IP leaks any halfway serious company could reverse engineer in a week, but on the other hand encourage their employees to vibe all company secrets into the cloud?
It's a bit trite, but the answers are: 1) money 2) money
Can't repair your own stuff and either need to use authorized repair shop or buy new? The company gets more money.
Force your developers to forgo quality in efforts to produce more cruft in less time? The company gets more money.
Of course, only considering short-term, long-term they'll lose money, but at that point all the executives and managers already got their bonuses and probably moved on to doing the same in some other company.
> Why do these companies put so much effort into fighting right to repair to avoid IP leak
Only if you believe they are truthful about the reason for fighting right to repair. I think the reason for fighting right to repair is to reduce the time before a replacement purchase is required.
> but on the other hand encourage their employees to vibe all company secrets into the cloud?
Lots of companies do ban or restrict usage of LLMs etc.
Uhh a lot of companies did and are strict on what AI tools are allowed.
The main thing I had to wait on for a long time was support for preventing 3rd party code from being plagiarized since our code base was intermingled with partnered companies.
Isn't this solving a slightly, but very significantly different problem?
You could serve the very same data in two different ways: One to present to the users and one to hand over to scrapers. Of course, some sites would be too difficult or costly to transform into a common underlying cache format, but people who WANT their sides accessible to scrapers could easily help the process along a bit or serve their site in the necessary format in the first place.
But the key is:
A tool using a "pre-scraped" version of a site has very likely very different requirements of how a CDN caches this site. And this could be easily customizable by those using this endpoint.
Want a free version? Ok, give us the list of all the sites you want, then come back in 10min and grab everything in one go, the data will be kept ready for 60s. Got an API token? 10 free near-real-time request for you and they'll recharge at a rate of 2 per hour. Want to play nice? Ask the CDN to have the requested content ready in 3 hours. Got deep pockets? Pay for just as many real-real-time requests as you need.
What makes this so different is that unless customers are willing to hand over a lot of money, you dont need to cache anything to serve requests at all. Potentially not even later if you got enough capacity to serve the data for scheduled requests from the storage network directly.
You just generate an immediate promise response to the request telling them to come back later. And depending on what you put into that promise, you've got quite a lot of control over the schedule yourself.
- Got a "within 10min" request but your storage network has plenty if capacity in 30s? Just tell them to come back in 30s.
- A customer is pushing new data into your network around 10am and many bots are interested in getting their hands on it as soon as possible, making requests for 10am to 10:05? Just bundle their requests.
- Expected data still not around at 10:05? Unless the bots set an "immediate" flag (or whatever) indicating that they want whatever state the site is in right now, just reply with a second promise when they come back. And a third if necessary... and so on.