A continuation of Compilation of Acarya Malcolm Smith's 42157 Dharmawheel Posts

Added Table of Contents.

Also added compilation of posts by Astus, Krodha (Kyle Dixon), Geoff (Jnana), Zen Master Meido Moore, all of whom John Tan and I likes. Update: also added Geoff in Dhammawheel, my posts, Lotus_Bitch, Ven. Dhammanando and Ven. Hui-feng.


Astus Dharmawheel Posts: https://app.box.com/s/ln2rvagp8u7xx0uytci78defdawgctsm

Krodha (Kyle Dixon) Dharmawheel Posts: https://app.box.com/s/k0frsynnhxkivdsvjiqyhvt0zc8blbsl

Update: Krodha's Dharmawheel Posts are now available in audio recordings at Highly Recommended: (SoundCloud) Audio Recordings of Kyle Dixon/Krodha/Asunthatneverset's Posts on Dharmawheel

(Note: the above are Krodha's Dharmawheel Posts, do also check out Krodha's Reddit posts compilation:

A Compilation of Some of Kyle Dixon's Wonderful Postings (part 1)


A Compilation of Some of Kyle Dixon's Wonderful Postings Part 2

A Compilation of Some of Kyle Dixon's Wonderful Postings Part 3

A Compilation of Some of Kyle Dixon (Krodha)'s Wonderful Reddit Postings Part 4)



Geoff (Jnana) Dharmawheel Posts: https://app.box.com/s/axsh5qeue8vdy47p7enztv9oryjr5qf7

Zen Master Meido Moore Dharmawheel Posts: https://app.box.com/s/lbiudrkbiueq89y2z4xvx499d6st95y8


Also, from previous post:

Malcolm posts in 12 files (docx and pdf and table of contents provided): https://app.box.com/s/ju3gothq09bmzzpcehv045ylwegvfzaj

Malcolm posts in 3 files (docx and pdf and table of contentsprovided): https://app.box.com/s/pwn72amv07cptm1wekvc2twv3k980iiv

Malcolm posts in one file (docx and pdf and table of contents provided): https://app.box.com/s/ibii96pyxps6nlhy71pj76s5mi92qxr1


Update:

 Created an app which splits Malcolm's posts into PDFs and Word documents based on keywords and themes. 

  You can now download the compilation of Malcolm's writings split up into hundreds of themes and topics here: https://drive.google.com/file/d/1eAVyuxiw4xx8qIZ3-kydO_jSKCQsktqB/view?usp=share_link


Update 2:

 Here's more: 

Geoff (Nyana) Dhammawheel [The Theravada forum] Posts (This is the same Geoff as Jnana of the Mahayana Dharmawheel forum): https://app.box.com/s/pw4beip6gnnwflfrl3gq120xm01ljte2

 Xabir (myself, Soh) Dharmawheel Posts: https://app.box.com/s/j0razae3ogrif4zknkqasj7fbz26ay7t

 Xabir (myself, Soh) Dhammawheel Posts: https://app.box.com/s/3225lpmyh4b9kyhn4oh6fqnsyu71it63

 Lotus_Bitch Dharmawheel Posts: https://app.box.com/s/8sj323zd9quyr6uy0y4z6c6qplmkq3kx


Also, I have not verified whether the contents of the following authors are good, but I have found some of their contents rather interesting and so have included them here: 

Ven. Dhammanando's Dhammawheel Posts: https://app.box.com/s/ki5ns6ncs84erig2pud82hbfz2flp6ra

Ven. Hui-feng's Dharmawheel Posts: https://app.box.com/s/p9yvwnipgn2lk6m20ydxslc76pw30f5c

 

Updated my programs to GitHub which you can view and use:  https://github.com/sohweiyu2023/DharmawheelScraper



Update 3:


Update on dharmawheelscrapper:


Today, we've made substantial enhancements to the DharmawheelScraper project, a purpose-built tool for efficiently harvesting posts from the Dharmawheel platform for subsequent analysis and study. Previously, the project encountered challenges with the login functionality, hindering access to user-specific content. To tackle this, we implemented Selenium, a renowned tool for automating browsers. Selenium not only successfully resolved the login issues but also provided a more robust way of navigating through the website and interacting with its dynamic elements.


The primary focus of our enhancements was to create a resilient mechanism to traverse the site's pages and posts while preventing the scraper from stopping prematurely due to stale or changed webpage elements.


Furthermore, we acknowledged a limitation pertaining to new accounts, where they seem to be unable to scrape the most recent posts from the same day. We deduced that this might be due to account activity or age, and accordingly, provided guidance on the matter to end-users.


In essence, these improvements aim to make the DharmawheelScraper project more flexible, efficient, and resilient to the dynamic nature of web content, ensuring the accurate and reliable collection of valuable data.


——-

Programs I created:

DharmawheelScraper is designed to scrape posts from the DharmaWheel.net forum, specifically from the user specified as "Malcolm" and others. It will gather all the posts from this user and save them into text files in your computer. The program supports incremental updates, meaning it can scrape only the latest posts since the last scraping operation.

The Table of Contents Generator Program is a tool designed to process PDF documents and automatically generate a table of contents (TOC) based on the titles in each document. Each entry in the TOC includes the title and the corresponding page number(s). The TOC for each processed document is saved as a separate PDF file.

CombineTextFilesToWord is designed to combine multiple text files containing forum posts into a single Word document (.docx) and PDF file. The program can process a single folder or multiple subfolders, and you can choose to sort the files in ascending or descending order.
 
DharmawheelKeywordExtractor and KeywordsCategorisedWordPDF are two console-based applications designed to work together to streamline the process of organizing and analyzing text data.

Firstly, DharmawheelKeywordExtractor is responsible for identifying and quantifying the presence of certain keywords within a collection of text files. It takes a file with specified keywords and their possible synonyms, then examines the text files in a user-defined directory to track the frequency of these keywords and their synonyms. The result of this process is a dataset highlighting the occurrence count of each keyword.

Following this, the KeywordsCategorisedWordPDF application comes into play. This program takes the output of the DharmawheelKeywordExtractor - the keywords - and further categorizes the text data from the specified directory according to these keywords. It then compiles these categorized posts into Microsoft Word and PDF documents. By doing this, KeywordsCategorisedWordPDF enhances data organization and simplifies the task of reviewing a significant volume of text data. Each output file generated contains posts that are sorted by date and grouped according to their associated keyword or synonyms.

AutoScrapper is a powerful automation tool designed to streamline and simplify the execution of multiple console applications for scrapping the posts of Dharmawheel.net user(s). It facilitates the running of designated console programs, captures and labels their outputs for easy monitoring, and provides automated responses to their prompts. Configurable via a settings file, AutoScrapper can be set up to execute a variety of tasks based on specific requirements. Its integration with Windows Task Scheduler via batch scripts also enables routine automated operations, making it an invaluable tool for efficient system management and data processing.

AutoScrapper allows me to re-generate all the users' posts weekly based on latest updates, which I will upload to Box.com. 

 


....

Dharmawheel Post Scraper User Guide: Listening to PDFs on iPhone, Android, and Windows

This guide provides instructions for downloading and listening to PDF files from the Dharmawheel Post Scraper on iPhone, Android, and Windows devices, utilizing text-to-speech features.

For iPhone Users

Download the PDF files:

  1. Open Safari on your iPhone.
  2. Go to the provided box.com link with the zip file of PDFs.
  3. Tap the zip file to download, then tap again to extract the contents in the Files app.

Add PDF files to the Books app:

  1. Open the Files app.
  2. Find the folder with the extracted PDFs.
  3. Select the PDFs, then tap "Share."
  4. Choose "Copy to Books" to add them to your Books library.

Listen to PDFs using speech control:

  1. Go to Settings > Accessibility > Spoken Content.
  2. Enable "Speak Screen."
  3. Open a PDF in the Books app.
  4. Swipe down with two fingers from the top of the screen to start the speech control, which will read the PDF aloud.

For Android Users

Download the PDF files:

  1. Use Chrome to visit the box.com link.
  2. Tap the zip file to download, then extract its contents using a file manager app.

Add PDF files to a PDF reader app:

  1. Open the file manager.
  2. Locate and open a PDF file with your preferred PDF reader app.

Use text-to-speech features:

  1. Download a text-to-speech app like Voice Aloud Reader or explore the latest options on Google Play Store.
  2. Open the app, grant permissions, and choose a PDF file to listen to.
  3. Alternatively, use the built-in text-to-speech feature in Accessibility settings, if available on your Android device.

For Windows Users

Listen to PDFs using Microsoft Edge or Adobe Acrobat Reader:

  1. Open Microsoft Edge or Adobe Acrobat Reader.
  2. Open the PDF file.
  3. In Edge, click the book with speaker icon; in Acrobat Reader, find the read-aloud option in the View menu.
  4. Select "Read Aloud" and use the controls to manage playback.
  5. Adjust reading speed and voice in "Voice options."
  6. Stop the reading with the "X" button in the control bar.

Note: The "Read Aloud" feature is optimized for text-based PDFs and might not work as expected with PDFs composed of scanned images.

…..



Update: I noticed in 2011, some of the early posts by Krodha (Kyle Dixon) may be prone to nihilism. That was before he was guided by Acarya Malcolm Smith. Hence do take note that everyone's understanding matures over time and their current understanding may not reflect what was spoken more than a decade ago. Nonetheless all of Kyle's postings are worth going through and incredibly insightful (and I believe he realised anatman in 2011 or even before -- Advice from Kyle Dixon) even from the beginning, besides a few of those earliest postings which may be a little misleading.

Thusness had many praises for Kyle even in 2012 and said his posts were no less insightful than great Buddhist masters, and he said commented on posts by Kyle (asunthatneversets - see early compilations in https://www.awakeningtoreality.com/2012/03/a-sun-that-never-sets.html):
3/14/2012 1:16 PM: John: I went through posts by asunthatneversets, it is well written
3/14/2012 1:19 PM: Soh Wei Yu: Oic..

4/15/2012 6:05 PM: John: ASunthatNeverSets has many good pointers.  But there r still certain aspects that need deeper insight and clarity
4/15/2012 6:06 PM: Soh Wei Yu: Oic
4/15/2012 6:07 PM: John: I would prefer u to look into it instead of dwelling into other matters that will not help to deepen ur insights and understanding
4/15/2012 6:08 PM: John: For u now it is not easy to find an article that can provide good pointers...so treasure it.  Not to overlook it simply becoz it is written by some anonymous Internet forumer.


Kyle Dixon initially seemed to downplay concepts like rebirth, karma, and merits in 2011. His views shifted in 2012 after guidance from Malcolm. He shared with me,"Merit was something that I sort of passed off as a made up thing (like sin etc..) for a long time but I'm starting to see how that applies with one's intentions and that compassionate resonance.“ "Interesting.. My mentor hammers on merit so much and i used to just think he was being dogmatic but I see that it's a viable and legitimate facet of experience. I've just recently been starting to really focus on that and have been wanting to get back to doing more group practices like i used to... I noticed that when I was doing ganapujas regularly at the local practice center I was having far more peak insights and I never made that correlation til this last month. So interesting that it comes up here with you I feel that's no coincidence My mentor just said last week "Get your ass to the ganapujas I don't want you missing any more of them" ...he dedicates his merit everytime he does anything (especially before eating/drinking and after practice) and was really stressing that I do the same."

John remarked on the same day, "What Kyle said is important. Did you tell him about merit?" referencing the article "On the Importance of Merits".

Kyle spoke about this later as well, possibly in 2012, 


And to clarify, I only harp on this issue like I do because I used to carry the same view: that everything is already perfect... there's nothing to realize... there's no one here to do anything... there's no such thing as "correct" or "incorrect"... or that concepts were the enemy, and so on, and so on, and so on. All the same narratives you see being spun by most neo-nondual teachers and systems. I remember I used to argue with a friend/mentor all the time about how he doesn't get it, and he's just fooling himself with practice and so on. And I used to cite the same quotations from Longchenpa and others that were speaking from the point of view of the ultimate, and I (in my delusion) provided them as proof that I was correct etc.

Then one day that changed, and I experientially tasted what all of these masters are pointing to. And I was shown directly that I had been wrong, and that was very humbling.

That made these teachings real for me. And surprisingly, instead of continuing to reject practice, and all of these other aspects of these systems that I had previously thought to be extraneous and a waste of time... I saw their value and their place for the first time. It became clear how and why they are applied, where they fit into the scheme of things... and I saw the sheer wisdom behind the structures that I had once mistakenly rejected.

So I only speak out against those who attempt to propagate the same mistakes because I've been there. I was so certain that I was right, and that I "got it", and that others didn't understand. And I was so wrong... unbelievably wrong. 

I'm no teacher or messiah, I don't have a superiority complex or have some strange need to be "right", it's nothing like that. I simply speak out because when I see others who appear to be passionate about these teachings, making the same mistakes I made, I see myself, I can't help but to want to say "hey, it really isn't that way." And if all I accomplish is at least planting some shred of a seed of a possibility that X person may think twice and consider being open to the fact that they don't have it completely figured out, then that is good enough for me. If not, that is alright too, but at least I can say I tried......
” – Kyle Dixon

 

Kyle Dixon: Stian, Mr. J is implying that there is nothing to do, because all notions of 'anything to do', 'emptiness', 'right view', 'wrong view', 'ignorance', 'defilement' etc., are nothing more than concepts which arise and fall within the space of 'awareness' which cannot be improved upon or defiled... that is his view he is proposing. I beg to differ... to me this view is nothing more than a license for stagnation and complacency which only serves to perpetuate the issue. It is a false sense of security that one has already 'arrived' so to speak.

 

The quote applies to Mr. J, because he claims precisely what Jigme Lingpa is describing in that statement to be true, and did so directly above that quotation: Jackson's view being, nothing need be done, because all concepts (including those of the dharma such as emptiness etc.), are nothing more than thoughts which arise in what is already complete, as expressions of what is already complete. His logic therefore being, there is no need to even entertain such notions, one is already innately realized. Jigme Lingpa is stating that such a notion is an incorrect view which actually severs one from the profound dharma. Mr. J’s assertion that 'nothing needs fixin' is a view he has touted for a very long time now, it is very unskillful and misleading.

Yesterday at 1:41pm · Like

 

Mr. J: My view Kyle, is not that "nothing need be done". Bringing an end to conceptualizing is a huge task. Buddha stated "conceptualizing is a cancer". It is the sole source of samsara. If the cause of samsara ceases we only have nirvana as experience. However when that task has come to completion, then we know the space in which Nagarjuna lived along with all the masters of the Zen tradtion.

Yesterday at 1:48pm · Like

 

Kyle Dixon: Stian, Yes, right and wrong should surely be understood as a necessary and indispensable duality when it comes to the dharma. Right view is that which will lead to realization, wrong view is that which will perpetuate delusion.

 

Right and wrong are conventional as well, any conceptual structure we are implementing here is conventional.

 

'Full' can only be a conventional designation, the ultimate nature of 'full' is it's emptiness.

Yesterday at 1:51pm · Like · 1

 

Kyle Dixon: It's nothing more than a task that requires skillful recognition. At any rate though, it isn't simply a case of ending conceptualization... only conceptualization rejects conceptualization.

Yesterday at 1:53pm · Like · 1”

Also of relevance here is a passage by Longchenpa that me (Soh) and John Tan liked a lot:

Longchenpa on Nihilism

From Finding Rest in the Nature of Mind.

"Those who scorn the law of karmic cause and fruit

Are students of the nihilist view outside the Dharma.

They rely on the thought that all is void;

They fall in the extreme of nothingness

And go from higher to lower states.

They have embarked on an evil path

And from the evil destinies will have no freedom,

Casting happy states of being far away.

”The law of karmic cause and fruit,

Compassion and the gathering of merit -

All this is but provisional teaching fit for children:

Enlightenment will not be gained thereby.

Great yogis should remain without intentional action.

They should meditate upon reality that is like space.

Such is the definitive instruction.”

The view of those who speak like this

Of all views is the most nihilist:

They have embraced the lowest of all paths.

How strange is this!

They want a fruit but have annulled its cause.

If reality is but a space-like void,

What need is there to meditate?

And if it is not so, then even if one meditates

Such efforts are to no avail.

If meditation on mere voidness leads to liberation,

Even those with minds completely blank

Attain enlightenment!

But since those people have asserted meditation,

Cause and its result they thus establish!

Throw far away such faulty paths as these!

The true, authentic path asserts

The arising in dependence of both cause and fruit,

The natural union of skillful means and wisdom.

Through the causality of nonexistent but appearing acts,

Through meditation on the nonexistent but appearing path,

The fruit is gained, appearing and yet nonexistent;

And for the sake of nonexistent but appearing beings,

Enlightened acts, appearing and yet nonexistent, manifest.

Such is pure causality’s profound interdependence.

This is the essential pith

Of all the Sutra texts whose meaning is definitive

And indeed of all the tantras.

Through the joining of the two accumulations,

The generation and completion stages,

Perfect buddhahood is swiftly gained.

Thus all the causal processes

Whereby samsara is contrived should be abandoned,

And all acts that are the cause of liberation

Should be earnestly performed.

High position in samsara

And the final excellence of buddhahood

Will speedily be gained."

from Finding Rest in the Nature of Mind (Volume 1)

Also by Longchenpa:

"To reject practice by saying, ‘it is conceptual!’ is the path of fools. A tendency of the inexperienced and something to be avoided.”


- To reject practice is the path of fools - Longchenpa

......

 https://www.facebook.com/groups/AwakeningToReality/posts/9212914758749872/?__cft__[0]=AZWQEcbdzmqyXZF9wPYroQntKm6ES_Y34ziixUsI-eHUJTyJqWy5wn_BOlh_dDhyN32SGEvaS9PoHfEc5NCclbPzXLHbOohuvh2Co_Jvn7RdSPpVz3L7RXcnpjbYjXO6ylDU16Zt2LZnPIgygEy9MmnKrnvueRKqWFPIYRlfkOg890SPpbjObGTWlIruFWVAxt4&__tn__=%2CO%2CP-R

Soh Wei Yu

Author

Admin

I will update to include table of content page later

Reply1w

Michael Bridge

It might be interesting to use OpenAI embeddings via Langchain to create a question/answer bot based on the content. Embeddings are a lot cheaper than fine tuning, but there would be costs involved.

Reply5d

Robert Dominik Tkanka

Joyful Ebbot 🧡👓

Reply3d

Soh Wei Yu

Author

Admin

Michael Bridge John Tan was doing coding for similar things and for the AtR gpt project. He just said “I have completed writing the program querying on books using opena, langchain and chroma....but needs lots of refinentment.

I wonder how to try the AI. The answers are weird...ahha” “It is like querying a book and talking to a book. The books answer back.”

Reply2dEdited

Soh Wei Yu

Author

Admin

Created the third program:

User's Guide for Dharmawheel Table of Contents Generator Program

Introduction

The Table of Contents Generator Program is a tool designed to process PDF documents and automatically generate a table of contents (TOC) based on the titles in each document. Each entry in the TOC includes the title and the corresponding page number(s). The TOC for each processed document is saved as a separate PDF file.

This guide provides instructions for using the Table of Contents Generator Program.

Prerequisites

.NET Runtime installed on your system. This program is built with .NET, and you will need the .NET Runtime to run it. You can download it here.

The program file (DharmawheelTableOfContentsCreator.exe or similar). You should have received this file separately.

Your PDF documents should follow a specific format where each title is prefixed with "Title: ".

Running the Program

To run the program, open a command prompt, navigate to the directory containing the program file, and enter the following command:

DharmawheelTableOfContentsCreator.exe

This will start the program, and you will see a prompt in the command line interface.

Using the Program

When you run the program, it will first ask you to make a choice:

Enter '1' to create table of contents for all files in a directory and its subdirectories, or '2' to create a table of contents for a specific file:

Enter 1 or 2 depending on your needs, and press Enter.

Option 1: Process All Files in a Directory and Its Subdirectories

If you chose 1, you will be prompted to enter the path of the directory containing the PDF files you want to process:

Enter the directory path:

Enter the path to the directory, and press Enter. The program will then count the PDF files in that directory and its subdirectories and ask for confirmation before proceeding:

This will process [number] files. Are you sure you want to proceed? (y/n)

Enter y to proceed or n to cancel, and press Enter. If you chose to proceed, the program will start processing the files one by one, providing progress updates as it goes.

Option 2: Process a Specific File

If you chose 2, you will be prompted to enter the path of the specific PDF file you want to process:

Enter the file path:

Enter the path to the file, and press Enter. The program will then process this single file.

Output

After processing each file, the program will generate a new PDF file containing the TOC. The TOC file will be saved in the same directory as the original document, with the same name followed by _TableOfContents. For example, if the original document is named MyDocument.pdf, the TOC file will be named MyDocument_TableOfContents.pdf.

The TOC consists of lines of text. Each line includes a title and the corresponding page number(s) in the format Title: [page numbers].

Troubleshooting

If the program encounters an error, it will display a message in the command line interface. Note the message and consult the program's documentation or support resources. If the problem persists, contact the program's support team with the details of the error message and what you were doing when the error occurred.

Reply3hEdited

Aaron Bohannon

It boggles my mind to think that those who have attained non-dual awareness can write so much. When I had attained a relatively stable, longer-term state of what we might call "non-conceptual awareness", I would always need at least an hour or so to fully find my way back to that state after writing or conversing for more than a few hours. I didn't use sitting meditation to do that, but I just needed time alone to shake off the pull away from the temptation to use language in my thinking. And on the whole, I wasn't very interested in using lauguage much back then. One of the reasons that I haven't attempted to reestablish my relationship with that state of mind is that these days I spend most of my time writing, so I feel as though it would be relatively futile for me to make any great effort. (Now my main interest is in the philosophy of language. 🙂 )

Reply2h

Soh Wei Yu

Author

Admin

Updated with Table of Contents:

Soh Wei Yu

Author

Admin

Generated output of Malcolm's forum posts in PDF, word and text files: https://app.box.com/s/ju3gothq09bmzzpcehv045ylwegvfzaj

Malcolm12PartsForumPosts.zip | Powered by Box

APP.BOX.COM

Malcolm12PartsForumPosts.zip | Powered by Box

Malcolm12PartsForumPosts.zip | Powered by Box

ReplyRemove Preview1w

Soh Wei Yu

Author

Admin

Warning: The following word and PDF documents are super huge. Save all your files before attempting to open them, as I cannot guarantee that opening the files will not crash your system.

It is recommended that you run the files in Malcolm12PartsForumPosts.zip instead from the previous post.

Malcolm posts in 3 files(docx and pdf provided): https://app.box.com/s/pwn72amv07cptm1wekvc2twv3k980iiv

Malcolm posts in one file (docx and pdf provided): https://app.box.com/s/ibii96pyxps6nlhy71pj76s5mi92qxr1

Warning: the one file contains about 10,000 pages of texts and will likely crash your system if you do not have enough RAM and processing power.

Malcolm12PartsForumPosts.zip | Powered by Box

APP.BOX.COM

Malcolm12PartsForumPosts.zip | Powered by Box

Malcolm12PartsForumPosts.zip | Powered by Box

ReplyRemove Preview2h

Soh Wei Yu

Author

Admin

Longest table of contents I've ever seen. 187 pages long table of contents. About the length of the power of now (191 pages).

Reply2h

 

 

Update:

 Created an app which splits Malcolm's posts into PDFs and Word documents based on keywords and themes. 

  You can now download the compilation of Malcolm's writings split up into hundreds of themes and topics here: https://drive.google.com/file/d/1eAVyuxiw4xx8qIZ3-kydO_jSKCQsktqB/view?usp=share_link


0 Responses